[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:40 dist-test-slave-jlzn krb5kdc[1362](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:40 dist-test-slave-jlzn krb5kdc[1362](info): set up 2 sockets
Aug 09 02:20:40 dist-test-slave-jlzn krb5kdc[1362](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 02:20:41.684582 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:20:41 dist-test-slave-jlzn krb5kdc[1362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:20:41.797039 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43191
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:43191
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:41.903678 1384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:41.903957 1384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:41.904018 1384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:41.907882 1384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:41.907931 1384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:41.907958 1384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:41.907979 1384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:41.908005 1384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:41.913043 1384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:43191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:41.913945 1384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:41.914875 1384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:41.923020 1397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:41.922995 1394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:41.923118 1384 server_base.cc:1034] running on GCE node
W20260809 02:20:41.923053 1395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:41.923712 1384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:41.924928 1384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:41.926086 1384 hybrid_clock.cc:648] HybridClock initialized: now 1786242041926099 us; error 76 us; skew 500 ppm
Aug 09 02:20:41 dist-test-slave-jlzn krb5kdc[1362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242041, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:41.929251 1384 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:20:41.930024 1384 webserver.cc:460] Webserver started at http://127.1.81.254:37669/ using document root <none> and password file <none>
I20260809 02:20:41.930509 1384 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:41.930564 1384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:41.930716 1384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:41.932734 1384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "b715a20fdcd649ed91ce2ff3cc068669"
format_stamp: "Formatted at 2026-08-09 02:20:41 on dist-test-slave-jlzn"
server_key: "2f65c1112a6cf93e24da4ab5673ff243"
server_key_iv: "4fabc8ca132efea724858e356fafa295"
server_key_version: "encryptionkey@0"
I20260809 02:20:41.933241 1384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "b715a20fdcd649ed91ce2ff3cc068669"
format_stamp: "Formatted at 2026-08-09 02:20:41 on dist-test-slave-jlzn"
server_key: "2f65c1112a6cf93e24da4ab5673ff243"
server_key_iv: "4fabc8ca132efea724858e356fafa295"
server_key_version: "encryptionkey@0"
I20260809 02:20:41.936617 1384 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:41.938746 1405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:41.939874 1384 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:41.939976 1384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "b715a20fdcd649ed91ce2ff3cc068669"
format_stamp: "Formatted at 2026-08-09 02:20:41 on dist-test-slave-jlzn"
server_key: "2f65c1112a6cf93e24da4ab5673ff243"
server_key_iv: "4fabc8ca132efea724858e356fafa295"
server_key_version: "encryptionkey@0"
I20260809 02:20:41.940055 1384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:41.961440 1384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:41.963871 1384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:41.964023 1384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:41.970566 1384 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:43191
I20260809 02:20:41.970610 1477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:43191 every 8 connection(s)
I20260809 02:20:41.971439 1384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:41.972311 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1384
I20260809 02:20:41.972438 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:20:41.973624 1351 external_mini_cluster.cc:1428] Setting key 054feb3b0046d3140ef0609f4d15d869
I20260809 02:20:41.974154 1479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:41.980518 1479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669: Bootstrap starting.
I20260809 02:20:41.982921 1479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:41.983819 1479 log.cc:824] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:41.985800 1479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669: No bootstrap required, opened a new log
I20260809 02:20:41.989130 1479 raft_consensus.cc:348] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b715a20fdcd649ed91ce2ff3cc068669" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43191 } }
I20260809 02:20:41.989401 1479 raft_consensus.cc:374] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:41.989464 1479 raft_consensus.cc:729] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b715a20fdcd649ed91ce2ff3cc068669, State: Initialized, Role: FOLLOWER
I20260809 02:20:41.989917 1479 consensus_queue.cc:260] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b715a20fdcd649ed91ce2ff3cc068669" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43191 } }
I20260809 02:20:41.990082 1479 raft_consensus.cc:388] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:41.990161 1479 raft_consensus.cc:482] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:41.990262 1479 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:41.991243 1479 raft_consensus.cc:504] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b715a20fdcd649ed91ce2ff3cc068669" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43191 } }
I20260809 02:20:41.991621 1479 leader_election.cc:302] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b715a20fdcd649ed91ce2ff3cc068669; no voters:
I20260809 02:20:41.991964 1479 leader_election.cc:288] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:41.992043 1486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:41.992246 1486 raft_consensus.cc:686] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [term 1 LEADER]: Becoming Leader. State: Replica: b715a20fdcd649ed91ce2ff3cc068669, State: Running, Role: LEADER
I20260809 02:20:41.992542 1486 consensus_queue.cc:237] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b715a20fdcd649ed91ce2ff3cc068669" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43191 } }
Aug 09 02:20:41 dist-test-slave-jlzn krb5kdc[1362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:41.993213 1479 sys_catalog.cc:564] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:41.994019 1491 sys_catalog.cc:455] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b715a20fdcd649ed91ce2ff3cc068669. Latest consensus state: current_term: 1 leader_uuid: "b715a20fdcd649ed91ce2ff3cc068669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b715a20fdcd649ed91ce2ff3cc068669" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43191 } } }
I20260809 02:20:41.994163 1491 sys_catalog.cc:458] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:41.994278 1490 sys_catalog.cc:455] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b715a20fdcd649ed91ce2ff3cc068669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b715a20fdcd649ed91ce2ff3cc068669" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43191 } } }
I20260809 02:20:41.994854 1490 sys_catalog.cc:458] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:41.995064 1503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:41.998466 1503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:41.999989 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:41.976617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51864 (local address 127.1.81.254:43191)
0809 02:20:41.977073 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:41.977093 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:41.978064 (+ 971us) server_negotiation.cc:407] Connection header received
0809 02:20:41.981969 (+ 3905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:41.981984 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:41.982272 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:41.982521 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:41.985352 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:41.986361 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:41.988001 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:41.989016 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:41.989134 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:41.993870 (+ 4736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:41.993877 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:41.993894 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:41.993925 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:41.995919 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:41.996531 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:41.996538 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:41.996544 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:41.996694 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:41.997092 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:41.997095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:41.997097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:41.997551 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:41.997773 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:41.998780 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0809 02:20:41.999055 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":128,"threads_started":1}
I20260809 02:20:42.004416 1503 catalog_manager.cc:1347] Generated new cluster ID: 791b939bc7b049c090bf2477881b03e5
I20260809 02:20:42.004478 1503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:42.040266 1503 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:42.041461 1503 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:42.049204 1503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b715a20fdcd649ed91ce2ff3cc068669: Generated new TSK 0
I20260809 02:20:42.049922 1503 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:20:42.082150 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43191
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:42.189502 1520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:42.189728 1520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:42.189771 1520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:42.193732 1520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:42.193784 1520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:42.193858 1520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:20:42.198933 1520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43191
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:42.199887 1520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:42.200805 1520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:42.209982 1529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:42.209985 1527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:42.209986 1526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:42.210310 1520 server_base.cc:1034] running on GCE node
I20260809 02:20:42.210696 1520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:42.211264 1520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:42.212414 1520 hybrid_clock.cc:648] HybridClock initialized: now 1786242042212382 us; error 45 us; skew 500 ppm
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:42.215030 1520 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:20:42.216014 1520 webserver.cc:460] Webserver started at http://127.1.81.193:32905/ using document root <none> and password file <none>
I20260809 02:20:42.216662 1520 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:42.216741 1520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:42.216955 1520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:42.219275 1520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "b40a0b0f153d4cb992a411a6d364d042"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "5b5e0b6613d247ea660dcf974df6d7fe"
server_key_iv: "ed6d2b43f934eeefd7c99f460514ed08"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.219766 1520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "b40a0b0f153d4cb992a411a6d364d042"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "5b5e0b6613d247ea660dcf974df6d7fe"
server_key_iv: "ed6d2b43f934eeefd7c99f460514ed08"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.223188 1520 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:20:42.225419 1541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.226500 1520 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:42.226598 1520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "b40a0b0f153d4cb992a411a6d364d042"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "5b5e0b6613d247ea660dcf974df6d7fe"
server_key_iv: "ed6d2b43f934eeefd7c99f460514ed08"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.226691 1520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:42.252110 1520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:42.254593 1520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:42.254732 1520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:42.255241 1520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:42.256014 1520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:42.256063 1520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.256100 1520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:42.256120 1520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.264673 1520 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:42647
I20260809 02:20:42.264705 1695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:42647 every 8 connection(s)
I20260809 02:20:42.265442 1520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:42.267458 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1520
I20260809 02:20:42.267552 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:42.267864 1351 external_mini_cluster.cc:1428] Setting key 7174214c39f86dc04c27e5bd67dcfdd4
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:20:42.279425 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:42.267027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:43483 (local address 127.1.81.254:43191)
0809 02:20:42.267145 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:42.267150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:42.267958 (+ 808us) server_negotiation.cc:407] Connection header received
0809 02:20:42.269535 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:42.269537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:42.269580 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:42.269649 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:42.270984 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.271513 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.273071 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.273290 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.273355 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:42.275966 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:42.275971 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:42.275974 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:42.276003 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:42.277480 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.277968 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.277972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.277974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.278069 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.278365 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.278369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.278371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.278597 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:42.278720 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:42.279168 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 02:20:42.279303 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:20:42.280105 1699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:42.267306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43191 (local address 127.1.81.193:43483)
0809 02:20:42.267779 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:42.267857 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:42.269321 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:42.269816 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:42.269824 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:42.270262 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:42.270845 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:42.270863 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.271640 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.271644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:42.272964 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:42.272976 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.273427 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.273431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:42.273625 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:42.274141 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:42.274160 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:42.275774 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:42.277592 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:42.277597 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:42.277606 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:42.277858 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:42.278150 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:42.278152 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:42.278153 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:42.278269 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:42.278713 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:42.278717 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:42.278918 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 02:20:42.279066 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 02:20:42.279300 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":103,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
I20260809 02:20:42.281239 1696 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43191
I20260809 02:20:42.281471 1696 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:42.281905 1696 heartbeater.cc:511] Master 127.1.81.254:43191 requested a full tablet report, sending...
I20260809 02:20:42.283316 1427 ts_manager.cc:194] Registered new tserver with Master: b40a0b0f153d4cb992a411a6d364d042 (127.1.81.193:42647)
I20260809 02:20:42.284415 1427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:43483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:20:42.295696 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43191
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:42.405197 1704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:42.405424 1704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:42.405483 1704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:42.409356 1704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:42.409411 1704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:42.409487 1704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:20:42.414535 1704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43191
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:42.415454 1704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:42.416389 1704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:42.425362 1711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:42.425375 1710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:42.425374 1714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:42.425597 1704 server_base.cc:1034] running on GCE node
I20260809 02:20:42.426057 1704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:42.426625 1704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:42.427791 1704 hybrid_clock.cc:648] HybridClock initialized: now 1786242042427777 us; error 25 us; skew 500 ppm
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:42.430416 1704 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:20:42.431193 1704 webserver.cc:460] Webserver started at http://127.1.81.194:43921/ using document root <none> and password file <none>
I20260809 02:20:42.431711 1704 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:42.431778 1704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:42.431981 1704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:42.433921 1704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "ce421b3f11fb4200ad8bc2306069dea9"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "b387e5698f78ee39abd33e5ea85bfa74"
server_key_iv: "2f443d31eabae8eacc3b20be139befb0"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.434449 1704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "ce421b3f11fb4200ad8bc2306069dea9"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "b387e5698f78ee39abd33e5ea85bfa74"
server_key_iv: "2f443d31eabae8eacc3b20be139befb0"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.437901 1704 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:20:42.440156 1726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.441251 1704 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:42.441362 1704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "ce421b3f11fb4200ad8bc2306069dea9"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "b387e5698f78ee39abd33e5ea85bfa74"
server_key_iv: "2f443d31eabae8eacc3b20be139befb0"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.441453 1704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:42.452330 1704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:42.455106 1704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:42.455274 1704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:42.455824 1704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:42.456596 1704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:42.456643 1704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.456692 1704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:42.456722 1704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.465158 1704 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:37459
I20260809 02:20:42.465179 1894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:37459 every 8 connection(s)
I20260809 02:20:42.465945 1704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:20:42.471848 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1704
I20260809 02:20:42.471967 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:42.472235 1351 external_mini_cluster.cc:1428] Setting key 99adcf43a552c41381f914748271d05e
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:42.478994 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:42.467529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:38489 (local address 127.1.81.254:43191)
0809 02:20:42.467650 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:42.467654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:42.468452 (+ 798us) server_negotiation.cc:407] Connection header received
0809 02:20:42.469723 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:42.469727 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:42.469784 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:42.469861 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:42.470929 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.471468 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.472962 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.473263 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.473356 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:42.475829 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:42.475834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:42.475837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:42.475862 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:42.477114 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.477565 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.477569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.477570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.477644 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.477961 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.477964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.477966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.478172 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:42.478267 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:42.478711 (+ 444us) server_negotiation.cc:299] Negotiation successful
0809 02:20:42.478829 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":43}
I20260809 02:20:42.479693 1898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:42.467892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43191 (local address 127.1.81.194:38489)
0809 02:20:42.468321 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:42.468361 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:42.469527 (+ 1166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:42.470022 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:42.470028 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:42.470359 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:42.470794 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:42.470807 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.471594 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.471597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:42.472846 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:42.472856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.473402 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.473406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:42.473559 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:42.474081 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:42.474101 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:42.475657 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:42.477221 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:42.477226 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:42.477239 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:42.477475 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:42.477724 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:42.477727 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:42.477729 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:42.477874 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:42.478269 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:42.478276 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:42.478497 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 02:20:42.478653 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 02:20:42.478950 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":113,"threads_started":1}
I20260809 02:20:42.480880 1896 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43191
I20260809 02:20:42.481087 1896 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:42.481521 1896 heartbeater.cc:511] Master 127.1.81.254:43191 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
I20260809 02:20:42.482528 1427 ts_manager.cc:194] Registered new tserver with Master: ce421b3f11fb4200ad8bc2306069dea9 (127.1.81.194:37459)
I20260809 02:20:42.483078 1427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:38489
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:20:42.496800 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43191
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:42.605342 1905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:42.605580 1905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:42.605623 1905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:42.609490 1905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:42.609537 1905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:42.609596 1905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:20:42.614537 1905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43191
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:42.615371 1905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:42.616281 1905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:42.625391 1914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:42.625427 1910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:42.625511 1905 server_base.cc:1034] running on GCE node
W20260809 02:20:42.625427 1917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:42.626045 1905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:42.626585 1905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:42.627737 1905 hybrid_clock.cc:648] HybridClock initialized: now 1786242042627715 us; error 34 us; skew 500 ppm
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:42.630366 1905 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:20:42.631191 1905 webserver.cc:460] Webserver started at http://127.1.81.195:35685/ using document root <none> and password file <none>
I20260809 02:20:42.631713 1905 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:42.631773 1905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:42.631991 1905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:42.633865 1905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "33ca190cb2884723be145520883e7935"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "c2fdc6a33d89063917a664be7acd3f2a"
server_key_iv: "e0cdc3a3069373c449f83aea27dc15e3"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.634394 1905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "33ca190cb2884723be145520883e7935"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "c2fdc6a33d89063917a664be7acd3f2a"
server_key_iv: "e0cdc3a3069373c449f83aea27dc15e3"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.637809 1905 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:20:42.639961 1929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.641042 1905 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:42.641141 1905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "33ca190cb2884723be145520883e7935"
format_stamp: "Formatted at 2026-08-09 02:20:42 on dist-test-slave-jlzn"
server_key: "c2fdc6a33d89063917a664be7acd3f2a"
server_key_iv: "e0cdc3a3069373c449f83aea27dc15e3"
server_key_version: "encryptionkey@0"
I20260809 02:20:42.641235 1905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:42.650949 1905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:42.653457 1905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:42.653596 1905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:42.654067 1905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:42.654793 1905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:42.654838 1905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.654874 1905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:42.654894 1905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:42.663275 1905 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:45715
I20260809 02:20:42.663335 2093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:45715 every 8 connection(s)
I20260809 02:20:42.664080 1905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:20:42.671976 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1905
I20260809 02:20:42.672086 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:42.672348 1351 external_mini_cluster.cc:1428] Setting key e8d7ec8917a32c133d8c4e9450e71500
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:42.676270 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:42.665644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:36659 (local address 127.1.81.254:43191)
0809 02:20:42.665773 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:42.665777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:42.666532 (+ 755us) server_negotiation.cc:407] Connection header received
0809 02:20:42.667746 (+ 1214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:42.667749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:42.667795 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:42.667877 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:42.668904 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.669414 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.670445 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.670648 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.670713 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:42.673068 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:42.673072 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:42.673075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:42.673104 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:42.674533 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.675048 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.675050 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.675051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.675132 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.675391 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.675393 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.675394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.675548 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:42.675618 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:42.676059 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 02:20:42.676155 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:20:42.676936 2102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:42.665959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43191 (local address 127.1.81.195:36659)
0809 02:20:42.666385 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:42.666426 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:42.667567 (+ 1141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:42.668035 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:42.668041 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:42.668351 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:42.668793 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:42.668806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.669501 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.669503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:42.670354 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:42.670363 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.670752 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.670755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:42.670894 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:42.671340 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:42.671355 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:42.672905 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:42.674648 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:42.674654 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:42.674667 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:42.674962 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:42.675204 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:42.675206 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:42.675208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:42.675329 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:42.675624 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:42.675628 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:42.675865 (+ 237us) client_negotiation.cc:769] Sending connection context
0809 02:20:42.676024 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 02:20:42.676253 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":111,"threads_started":1}
I20260809 02:20:42.677927 2097 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43191
I20260809 02:20:42.678108 2097 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:42.678498 2097 heartbeater.cc:511] Master 127.1.81.254:43191 requested a full tablet report, sending...
I20260809 02:20:42.679396 1427 ts_manager.cc:194] Registered new tserver with Master: 33ca190cb2884723be145520883e7935 (127.1.81.195:45715)
I20260809 02:20:42.679996 1427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:36659
I20260809 02:20:42.686295 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:20:42.711197 2111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:42.703068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48924 (local address 127.1.81.193:42647)
0809 02:20:42.703386 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:42.703397 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:42.703419 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:20:42.703465 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:42.703469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:42.703631 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:42.703754 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:42.704373 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.705149 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.705895 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.706239 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.706314 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:42.708444 (+ 2130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:42.708454 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:42.708464 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:42.708488 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:42.709793 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.710147 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.710156 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.710158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.710234 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.710418 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.710420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.710422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.710631 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:42.710787 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:42.710911 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 02:20:42.711033 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":113,"threads_started":1}
W20260809 02:20:42.712170 1578 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48924
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[1362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:20:42.736182 2111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:42.728840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48938 (local address 127.1.81.193:42647)
0809 02:20:42.728972 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:42.728976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:42.729061 (+ 85us) server_negotiation.cc:407] Connection header received
0809 02:20:42.729189 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:42.729192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:42.729233 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:42.729298 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:42.729939 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.730433 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.731259 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:42.731483 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:42.731577 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:42.733635 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:42.733638 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:42.733640 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:42.733669 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:42.734717 (+ 1048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.735086 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.735090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.735091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.735167 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:42.735407 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:42.735410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:42.735412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:42.735566 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:42.735687 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:42.735925 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 02:20:42.736035 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:20:42.737053 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1520
I20260809 02:20:42.755577 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1704
I20260809 02:20:42.763963 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1905
I20260809 02:20:42.770869 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1384
2026-08-09T02:20:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2228 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[2121](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[2121](info): set up 2 sockets
Aug 09 02:20:42 dist-test-slave-jlzn krb5kdc[2121](info): commencing operation
krb5kdc: starting...
W20260809 02:20:43.896759 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:20:43 dist-test-slave-jlzn krb5kdc[2121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:20:44.008745 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:38119
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:46205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:38119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:44.114678 2143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:44.114914 2143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:44.114969 2143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:44.118820 2143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:44.118872 2143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:44.118897 2143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:44.118918 2143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:44.118942 2143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:44.123867 2143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:46205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:38119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:38119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:44.124744 2143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:44.125648 2143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:44.133379 2151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:44.133426 2155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:44.133481 2152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:44.133963 2143 server_base.cc:1034] running on GCE node
I20260809 02:20:44.134558 2143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:44.135535 2143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:44.136693 2143 hybrid_clock.cc:648] HybridClock initialized: now 1786242044136665 us; error 38 us; skew 500 ppm
Aug 09 02:20:44 dist-test-slave-jlzn krb5kdc[2121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242044, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:44.139258 2143 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:20:44.140097 2143 webserver.cc:460] Webserver started at http://127.1.81.254:35501/ using document root <none> and password file <none>
I20260809 02:20:44.140586 2143 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:44.140645 2143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:44.140831 2143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:44.142745 2143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "5ee618145546405590b1073c772eb6c0"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "a1adf1bb758f4bc3524e81bfae772a7f"
server_key_iv: "d68e2a842ffb88e8f558ae5ee397e7df"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.143262 2143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "5ee618145546405590b1073c772eb6c0"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "a1adf1bb758f4bc3524e81bfae772a7f"
server_key_iv: "d68e2a842ffb88e8f558ae5ee397e7df"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.146740 2143 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:20:44.148943 2163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.150050 2143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:44.150159 2143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "5ee618145546405590b1073c772eb6c0"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "a1adf1bb758f4bc3524e81bfae772a7f"
server_key_iv: "d68e2a842ffb88e8f558ae5ee397e7df"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.150264 2143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:44.164594 2143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:44.166976 2143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:44.167132 2143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:44.173643 2143 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:38119
I20260809 02:20:44.173666 2241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:38119 every 8 connection(s)
I20260809 02:20:44.174510 2143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:44.177155 2242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:44.182353 2242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0: Bootstrap starting.
I20260809 02:20:44.183502 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2143
I20260809 02:20:44.183600 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:20:44.183853 1351 external_mini_cluster.cc:1428] Setting key 8b87db915fa561e97864ab95845d0055
I20260809 02:20:44.184952 2242 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:44.185719 2242 log.cc:824] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:44.187788 2242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0: No bootstrap required, opened a new log
I20260809 02:20:44.191987 2242 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee618145546405590b1073c772eb6c0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38119 } }
I20260809 02:20:44.192207 2242 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:44.192277 2242 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ee618145546405590b1073c772eb6c0, State: Initialized, Role: FOLLOWER
Aug 09 02:20:44 dist-test-slave-jlzn krb5kdc[2121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:44.192706 2242 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee618145546405590b1073c772eb6c0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38119 } }
I20260809 02:20:44.192839 2242 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:44.192904 2242 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:44.193004 2242 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:44.194054 2242 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee618145546405590b1073c772eb6c0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38119 } }
I20260809 02:20:44.194414 2242 leader_election.cc:302] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ee618145546405590b1073c772eb6c0; no voters:
I20260809 02:20:44.194757 2242 leader_election.cc:288] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:44.194837 2249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:44.195048 2249 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ee618145546405590b1073c772eb6c0, State: Running, Role: LEADER
I20260809 02:20:44.195380 2249 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee618145546405590b1073c772eb6c0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38119 } }
I20260809 02:20:44.196049 2242 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:44.196939 2252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ee618145546405590b1073c772eb6c0. Latest consensus state: current_term: 1 leader_uuid: "5ee618145546405590b1073c772eb6c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee618145546405590b1073c772eb6c0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38119 } } }
I20260809 02:20:44.197065 2252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:44.197391 2251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ee618145546405590b1073c772eb6c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee618145546405590b1073c772eb6c0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38119 } } }
I20260809 02:20:44.197491 2251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:44.198702 2263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:44.198753 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.184893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41826 (local address 127.1.81.254:38119)
0809 02:20:44.185313 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:44.185328 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:44.185361 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:20:44.185967 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:44.185983 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:44.186376 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:44.186657 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:44.187534 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.188544 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.189722 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.190176 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.190303 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.193028 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:44.193035 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:44.193051 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:44.193085 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:44.194888 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.195417 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.195423 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.195428 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.195563 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.195907 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.195911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.195913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.196414 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:44.197282 (+ 868us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:44.197425 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 02:20:44.197727 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":122,"threads_started":1}
I20260809 02:20:44.201655 2263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:44.206847 2263 catalog_manager.cc:1347] Generated new cluster ID: 87efca5ad93b45cb92ec1882c2d87319
I20260809 02:20:44.206907 2263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:44.220810 2263 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:44.221899 2263 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:44.228119 2263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ee618145546405590b1073c772eb6c0: Generated new TSK 0
I20260809 02:20:44.228770 2263 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:20:44.255913 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38119
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:46205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:44.363871 2281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:44.364106 2281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:44.364172 2281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:44.368054 2281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:44.368104 2281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:44.368185 2281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:20:44.373124 2281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:46205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:44.374017 2281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:44.374938 2281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:44.383936 2290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:44.383971 2281 server_base.cc:1034] running on GCE node
W20260809 02:20:44.383960 2289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:44.383939 2294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:44.384537 2281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:44.385128 2281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:44.386291 2281 hybrid_clock.cc:648] HybridClock initialized: now 1786242044386275 us; error 26 us; skew 500 ppm
Aug 09 02:20:44 dist-test-slave-jlzn krb5kdc[2121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242044, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:44.388856 2281 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:20:44.389622 2281 webserver.cc:460] Webserver started at http://127.1.81.193:43343/ using document root <none> and password file <none>
I20260809 02:20:44.390130 2281 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:44.390199 2281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:44.390388 2281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:44.392340 2281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "7d8571774148dd23a1c12ee703675edb"
server_key_iv: "df87782d91b86b8c1e8f7b8c321bb499"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.392866 2281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "7d8571774148dd23a1c12ee703675edb"
server_key_iv: "df87782d91b86b8c1e8f7b8c321bb499"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.396265 2281 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:44.398535 2305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.399605 2281 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:44.399724 2281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "7d8571774148dd23a1c12ee703675edb"
server_key_iv: "df87782d91b86b8c1e8f7b8c321bb499"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.399837 2281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:44.421116 2281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:44.423780 2281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:44.423986 2281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:44.424557 2281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:44.425365 2281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:44.425415 2281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.425467 2281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:44.425496 2281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.434226 2281 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:35695
I20260809 02:20:44.434263 2465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:35695 every 8 connection(s)
I20260809 02:20:44.435078 2281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:44.441268 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2281
I20260809 02:20:44.441376 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:44.441630 1351 external_mini_cluster.cc:1428] Setting key 57af5b5d6b62f7098beb04cd294d74f1
Aug 09 02:20:44 dist-test-slave-jlzn krb5kdc[2121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242044, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:44.448083 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.436713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:46103 (local address 127.1.81.254:38119)
0809 02:20:44.436867 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:44.436872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:44.438074 (+ 1202us) server_negotiation.cc:407] Connection header received
0809 02:20:44.438864 (+ 790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:44.438866 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:44.438914 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:44.438983 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:44.440021 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.440541 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.441861 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.442129 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.442228 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.444754 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:44.444758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:44.444760 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:44.444784 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:44.446168 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.446640 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.446643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.446645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.446747 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.447036 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.447039 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.447040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.447246 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:44.447337 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:44.447751 (+ 414us) server_negotiation.cc:299] Negotiation successful
0809 02:20:44.447914 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:20:44.448679 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.437071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38119 (local address 127.1.81.193:46103)
0809 02:20:44.437937 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:44.437976 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:44.438697 (+ 721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:44.439117 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:44.439123 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:44.439448 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:44.439899 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.439912 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.440625 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.440627 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.441751 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.441763 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.442289 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.442294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.442452 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.442934 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:44.442952 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:44.444599 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:44.446293 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:44.446298 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:44.446308 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:44.446538 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:44.446827 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:44.446829 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:44.446831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:44.446946 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:44.447336 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:44.447341 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:44.447535 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 02:20:44.447669 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 02:20:44.447926 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":558,"threads_started":1}
I20260809 02:20:44.449730 2466 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38119
I20260809 02:20:44.449968 2466 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:44.450500 2466 heartbeater.cc:511] Master 127.1.81.254:38119 requested a full tablet report, sending...
I20260809 02:20:44.452010 2194 ts_manager.cc:194] Registered new tserver with Master: b85410b2793f4e5a9c16fa81f2a3f7b8 (127.1.81.193:35695)
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:20:44.453194 2194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:46103
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:20:44.468031 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38119
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:46205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:44.574056 2478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:44.574290 2478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:44.574348 2478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:44.578197 2478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:44.578249 2478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:44.578325 2478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:20:44.583221 2478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:46205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:44.584118 2478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:44.585019 2478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:44.593969 2486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:44.594069 2484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:44.594112 2478 server_base.cc:1034] running on GCE node
W20260809 02:20:44.594002 2483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:44.594550 2478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:44.595113 2478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:44.596266 2478 hybrid_clock.cc:648] HybridClock initialized: now 1786242044596242 us; error 37 us; skew 500 ppm
Aug 09 02:20:44 dist-test-slave-jlzn krb5kdc[2121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242044, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:44.598930 2478 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:20:44.599665 2478 webserver.cc:460] Webserver started at http://127.1.81.194:33337/ using document root <none> and password file <none>
I20260809 02:20:44.600183 2478 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:44.600248 2478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:44.600422 2478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:44.602269 2478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "9110ce4c758049429e6f61fd26599184"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "86f430604203888b5558c4a4544af7cd"
server_key_iv: "be0d155ec16fdff032d751124af68203"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.602815 2478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "9110ce4c758049429e6f61fd26599184"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "86f430604203888b5558c4a4544af7cd"
server_key_iv: "be0d155ec16fdff032d751124af68203"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.606182 2478 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:20:44.608338 2494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.609390 2478 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:44.609493 2478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "9110ce4c758049429e6f61fd26599184"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "86f430604203888b5558c4a4544af7cd"
server_key_iv: "be0d155ec16fdff032d751124af68203"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.609577 2478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:44.620229 2478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:44.622859 2478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:44.623008 2478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:44.623492 2478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:44.624287 2478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:44.624333 2478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.624380 2478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:44.624408 2478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.632326 2478 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:37091
I20260809 02:20:44.632368 2659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:37091 every 8 connection(s)
I20260809 02:20:44.633069 2478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:20:44 dist-test-slave-jlzn krb5kdc[2121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242044, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:44.642927 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2478
I20260809 02:20:44.643050 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:44.643350 1351 external_mini_cluster.cc:1428] Setting key acde1a4a6829a2a17f72ee8e7e60dde7
I20260809 02:20:44.644847 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.634586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:52167 (local address 127.1.81.254:38119)
0809 02:20:44.634710 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:44.634714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:44.635431 (+ 717us) server_negotiation.cc:407] Connection header received
0809 02:20:44.636642 (+ 1211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:44.636645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:44.636692 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:44.636762 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:44.637742 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.638241 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.639245 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.639449 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.639509 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.641569 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:44.641573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:44.641575 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:44.641599 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:44.642817 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.643353 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.643356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.643357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.643448 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.643856 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.643860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.643862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.644045 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:44.644135 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:44.644575 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 02:20:44.644693 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:20:44.645516 2662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.634886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38119 (local address 127.1.81.194:52167)
0809 02:20:44.635299 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:44.635337 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:44.636475 (+ 1138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:44.636907 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:44.636914 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:44.637216 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:44.637622 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.637634 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.638324 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.638326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.639154 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.639163 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.639543 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.639545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.639678 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.640116 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:44.640131 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:44.641414 (+ 1283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:44.642917 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:44.642923 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:44.642936 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:44.643261 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:44.643534 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:44.643538 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:44.643540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:44.643740 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:44.644148 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:44.644154 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:44.644357 (+ 203us) client_negotiation.cc:769] Sending connection context
0809 02:20:44.644510 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 02:20:44.644801 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":106,"threads_started":1}
I20260809 02:20:44.646476 2660 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38119
I20260809 02:20:44.646682 2660 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:44.647084 2660 heartbeater.cc:511] Master 127.1.81.254:38119 requested a full tablet report, sending...
I20260809 02:20:44.648026 2194 ts_manager.cc:194] Registered new tserver with Master: 9110ce4c758049429e6f61fd26599184 (127.1.81.194:37091)
I20260809 02:20:44.648695 2194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:52167
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:20:44.668028 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38119
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:46205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:44.774029 2665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:44.774246 2665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:44.774286 2665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:44.778131 2665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:44.778173 2665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:44.778226 2665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:20:44.783263 2665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:46205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:44.784142 2665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:44.785022 2665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:44.794118 2674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:44.794157 2672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:44.794127 2671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:44.794288 2665 server_base.cc:1034] running on GCE node
I20260809 02:20:44.794700 2665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:44.795266 2665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:44.796422 2665 hybrid_clock.cc:648] HybridClock initialized: now 1786242044796402 us; error 31 us; skew 500 ppm
Aug 09 02:20:44 dist-test-slave-jlzn krb5kdc[2121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242044, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:44.799067 2665 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:20:44.799880 2665 webserver.cc:460] Webserver started at http://127.1.81.195:34803/ using document root <none> and password file <none>
I20260809 02:20:44.800369 2665 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:44.800426 2665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:44.800585 2665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:44.802425 2665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "01985ef7ecf64f81b0223c3a75059cc7"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "90caabc2ca1be01461505bb7ea6ee32b"
server_key_iv: "aa256301b9919c433e5efe88c0c7746d"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.802973 2665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "01985ef7ecf64f81b0223c3a75059cc7"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "90caabc2ca1be01461505bb7ea6ee32b"
server_key_iv: "aa256301b9919c433e5efe88c0c7746d"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.806418 2665 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:20:44.808657 2687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.809734 2665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:44.809828 2665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "01985ef7ecf64f81b0223c3a75059cc7"
format_stamp: "Formatted at 2026-08-09 02:20:44 on dist-test-slave-jlzn"
server_key: "90caabc2ca1be01461505bb7ea6ee32b"
server_key_iv: "aa256301b9919c433e5efe88c0c7746d"
server_key_version: "encryptionkey@0"
I20260809 02:20:44.809906 2665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:44.834770 2665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:44.837595 2665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:44.837756 2665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:44.838303 2665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:44.839085 2665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:44.839131 2665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.839172 2665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:44.839201 2665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:44.848922 2665 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:41759
I20260809 02:20:44.848942 2846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:41759 every 8 connection(s)
I20260809 02:20:44.849941 2665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:20:44.853372 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2665
I20260809 02:20:44.853479 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:44.853752 1351 external_mini_cluster.cc:1428] Setting key bae081e8e031ca3e4b7a719dc044c901
Aug 09 02:20:44 dist-test-slave-jlzn krb5kdc[2121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242044, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:44.867432 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.851847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:47825 (local address 127.1.81.254:38119)
0809 02:20:44.857213 (+ 5366us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:44.857217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:44.857230 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:20:44.857264 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:44.857266 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:44.857311 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:44.857385 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:44.858788 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.859629 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.860790 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.861158 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.861263 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.863695 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:44.863700 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:44.863703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:44.863735 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:44.865276 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.865732 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.865735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.865737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.865839 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.866120 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.866123 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.866125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.866351 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:44.866451 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:44.867127 (+ 676us) server_negotiation.cc:299] Negotiation successful
0809 02:20:44.867262 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5272}
I20260809 02:20:44.868948 2849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.852282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38119 (local address 127.1.81.195:47825)
0809 02:20:44.852814 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:44.852868 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:44.854481 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:44.857600 (+ 3119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:44.857607 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:44.858033 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:44.858617 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.858634 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.859757 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.859760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.860673 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.860684 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.861287 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.861290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.861424 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.861950 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:44.861965 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:44.863527 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:44.865386 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:44.865391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:44.865401 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:44.865640 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:44.865919 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:44.865922 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:44.865923 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:44.866041 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:44.866515 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:44.866522 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:44.866818 (+ 296us) client_negotiation.cc:769] Sending connection context
0809 02:20:44.867590 (+ 772us) client_negotiation.cc:240] Negotiation successful
0809 02:20:44.867968 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":153,"threads_started":1}
I20260809 02:20:44.870086 2847 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38119
I20260809 02:20:44.870316 2847 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:44.870731 2847 heartbeater.cc:511] Master 127.1.81.254:38119 requested a full tablet report, sending...
I20260809 02:20:44.871748 2194 ts_manager.cc:194] Registered new tserver with Master: 01985ef7ecf64f81b0223c3a75059cc7 (127.1.81.195:41759)
I20260809 02:20:44.872495 2194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:47825
I20260809 02:20:44.879170 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:20:44.889837 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.882504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41840 (local address 127.1.81.254:38119)
0809 02:20:44.882624 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:44.882628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:44.882843 (+ 215us) server_negotiation.cc:407] Connection header received
0809 02:20:44.882933 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:44.882936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:44.882983 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:44.883070 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:44.883632 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.884443 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.885250 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.885582 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.885680 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.886876 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:44.886880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:44.886883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:44.886910 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:44.888352 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.888728 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.888731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.888733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.888820 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:44.889018 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:44.889021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:44.889022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:44.889291 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:44.889417 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:44.889572 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 02:20:44.889684 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:20:44.894047 2194 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:20:44.897081 2194 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:44.911916 2864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.905809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:37091 (local address 127.0.0.1:37464)
0809 02:20:44.906053 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:44.906067 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:44.906149 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:44.907745 (+ 1596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:44.907748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:44.907764 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:44.907884 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.907891 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.909075 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.909079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.910409 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.910422 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.911479 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.911482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.911579 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.911601 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:20:44.911663 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 02:20:44.911742 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
I20260809 02:20:44.911950 2867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.906978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37464 (local address 127.1.81.194:37091)
0809 02:20:44.907315 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:44.907329 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:44.907347 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:20:44.907406 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:44.907410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:44.907590 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:44.908024 (+ 434us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:44.908187 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.908933 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.910525 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.911333 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.911474 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.911629 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:44.911679 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 02:20:44.911768 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":161,"threads_started":1}
I20260809 02:20:44.912010 2870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.907077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48696 (local address 127.1.81.193:35695)
0809 02:20:44.907616 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:44.907630 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:44.907651 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:20:44.907725 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:44.907730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:44.907939 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:44.908095 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:44.908280 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.909272 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.910413 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.911124 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.911226 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.911374 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:44.911755 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 02:20:44.911873 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":104,"threads_started":1}
I20260809 02:20:44.912353 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.906143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:35695 (local address 127.0.0.1:48696)
0809 02:20:44.906383 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:44.906397 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:44.906481 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:44.908089 (+ 1608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:44.908092 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:44.908108 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:44.908180 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.908185 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.909407 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.909410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.910288 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.910298 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.911250 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.911254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.911418 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.911462 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:20:44.911575 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 02:20:44.912259 (+ 684us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":555,"thread_start_us":88,"threads_started":1}
I20260809 02:20:44.915004 2371 tablet_service.cc:1467] Processing CreateTablet for tablet 11c3a2fef5994e439ad2e830170ba865 (DEFAULT_TABLE table=test-table [id=121daac2f08c4665af920430734b57c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:44.915153 2568 tablet_service.cc:1467] Processing CreateTablet for tablet 11c3a2fef5994e439ad2e830170ba865 (DEFAULT_TABLE table=test-table [id=121daac2f08c4665af920430734b57c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:44.916039 2371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c3a2fef5994e439ad2e830170ba865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:44.916206 2568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c3a2fef5994e439ad2e830170ba865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:44.921272 2862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.905443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:41759 (local address 127.0.0.1:39346)
0809 02:20:44.905760 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:44.905801 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:44.905915 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:44.907255 (+ 1340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:44.907261 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:44.907285 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:44.907403 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.907410 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.910546 (+ 3136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.910549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.911724 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:44.911734 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.920914 (+ 9180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.920918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:44.921007 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.921031 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:20:44.921076 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 02:20:44.921141 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":47,"thread_start_us":79,"threads_started":1}
I20260809 02:20:44.922034 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:44.906451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39346 (local address 127.1.81.195:41759)
0809 02:20:44.906771 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:44.906783 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:44.906806 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:20:44.906878 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:44.906883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:44.907072 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:44.907557 (+ 485us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:44.907711 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.908924 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.911886 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:44.920777 (+ 8891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:44.921593 (+ 816us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:44.921749 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:44.921802 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 02:20:44.921886 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":134,"threads_started":1}
I20260809 02:20:44.923017 2871 tablet_bootstrap.cc:492] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8: Bootstrap starting.
I20260809 02:20:44.924698 2752 tablet_service.cc:1467] Processing CreateTablet for tablet 11c3a2fef5994e439ad2e830170ba865 (DEFAULT_TABLE table=test-table [id=121daac2f08c4665af920430734b57c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:44.925169 2871 tablet_bootstrap.cc:654] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:44.925607 2752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c3a2fef5994e439ad2e830170ba865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:44.926235 2871 log.cc:824] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:44.928222 2871 tablet_bootstrap.cc:492] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8: No bootstrap required, opened a new log
I20260809 02:20:44.928228 2872 tablet_bootstrap.cc:492] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184: Bootstrap starting.
I20260809 02:20:44.928488 2871 ts_tablet_manager.cc:1397] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260809 02:20:44.931953 2872 tablet_bootstrap.cc:654] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:44.932407 2871 raft_consensus.cc:348] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:44.932710 2871 raft_consensus.cc:374] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:44.932720 2875 tablet_bootstrap.cc:492] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7: Bootstrap starting.
I20260809 02:20:44.932821 2871 raft_consensus.cc:729] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85410b2793f4e5a9c16fa81f2a3f7b8, State: Initialized, Role: FOLLOWER
I20260809 02:20:44.932981 2872 log.cc:824] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:44.933357 2871 consensus_queue.cc:260] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:44.934033 2466 heartbeater.cc:503] Master 127.1.81.254:38119 was elected leader, sending a full tablet report...
I20260809 02:20:44.934366 2871 ts_tablet_manager.cc:1428] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:20:44.934684 2875 tablet_bootstrap.cc:654] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:44.935707 2875 log.cc:824] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7: Log is configured to *not* fsync() on all Append() calls
W20260809 02:20:44.936084 2470 tablet.cc:2369] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:44.937716 2872 tablet_bootstrap.cc:492] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184: No bootstrap required, opened a new log
I20260809 02:20:44.937899 2872 ts_tablet_manager.cc:1397] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260809 02:20:44.941411 2875 tablet_bootstrap.cc:492] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7: No bootstrap required, opened a new log
I20260809 02:20:44.941360 2872 raft_consensus.cc:348] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:44.941618 2872 raft_consensus.cc:374] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:44.941646 2875 ts_tablet_manager.cc:1397] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 02:20:44.941687 2872 raft_consensus.cc:729] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9110ce4c758049429e6f61fd26599184, State: Initialized, Role: FOLLOWER
I20260809 02:20:44.942153 2872 consensus_queue.cc:260] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:44.943112 2872 ts_tablet_manager.cc:1428] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260809 02:20:44.943432 2660 heartbeater.cc:503] Master 127.1.81.254:38119 was elected leader, sending a full tablet report...
I20260809 02:20:44.945338 2875 raft_consensus.cc:348] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:44.945626 2875 raft_consensus.cc:374] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:44.945690 2875 raft_consensus.cc:729] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01985ef7ecf64f81b0223c3a75059cc7, State: Initialized, Role: FOLLOWER
I20260809 02:20:44.946116 2875 consensus_queue.cc:260] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:44.946753 2847 heartbeater.cc:503] Master 127.1.81.254:38119 was elected leader, sending a full tablet report...
I20260809 02:20:44.947137 2875 ts_tablet_manager.cc:1428] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 02:20:45.100919 2848 tablet.cc:2369] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:45.109450 2879 raft_consensus.cc:482] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:45.109643 2879 raft_consensus.cc:504] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:45.110745 2879 leader_election.cc:288] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01985ef7ecf64f81b0223c3a75059cc7 (127.1.81.195:41759), b85410b2793f4e5a9c16fa81f2a3f7b8 (127.1.81.193:35695)
I20260809 02:20:45.114869 2662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:45.110967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:41759 (local address 127.1.81.194:44981)
0809 02:20:45.111095 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:45.111108 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:45.111201 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:45.111441 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:45.111444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:45.111464 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:45.111601 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:45.111609 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.112528 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.112531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:45.113600 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:45.113612 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.114473 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.114476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:45.114582 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:45.114603 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:20:45.114666 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:20:45.114736 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 02:20:45.114879 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:45.111105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:44981 (local address 127.1.81.195:41759)
0809 02:20:45.111249 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:45.111253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:45.111267 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:20:45.111319 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:45.111321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:45.111358 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:45.111422 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:45.111754 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.112415 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.113708 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.114348 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.114453 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:45.114512 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:45.114707 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 02:20:45.114779 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:20:45.115499 2870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:45.111635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:35495 (local address 127.1.81.193:35695)
0809 02:20:45.111781 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:45.111784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:45.111796 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:20:45.111869 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:45.111872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:45.111923 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:45.111996 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:45.112261 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.113010 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.114447 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.114846 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.114953 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:45.115006 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:45.115331 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 02:20:45.115404 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:20:45.115499 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:45.111264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:35695 (local address 127.1.81.194:35495)
0809 02:20:45.111527 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:45.111553 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:45.111640 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:45.112016 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:45.112019 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:45.112036 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:45.112154 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:45.112160 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.113117 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.113120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:45.114314 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:45.114326 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.115098 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.115102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:45.115201 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:45.115225 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:20:45.115296 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:20:45.115362 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":63,"threads_started":1}
I20260809 02:20:45.115643 2780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c3a2fef5994e439ad2e830170ba865" candidate_uuid: "9110ce4c758049429e6f61fd26599184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01985ef7ecf64f81b0223c3a75059cc7" is_pre_election: true
I20260809 02:20:45.115958 2780 raft_consensus.cc:2454] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9110ce4c758049429e6f61fd26599184 in term 0.
I20260809 02:20:45.116192 2404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c3a2fef5994e439ad2e830170ba865" candidate_uuid: "9110ce4c758049429e6f61fd26599184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" is_pre_election: true
I20260809 02:20:45.116456 2496 leader_election.cc:302] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01985ef7ecf64f81b0223c3a75059cc7, 9110ce4c758049429e6f61fd26599184; no voters:
I20260809 02:20:45.116473 2404 raft_consensus.cc:2454] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9110ce4c758049429e6f61fd26599184 in term 0.
I20260809 02:20:45.116703 2879 raft_consensus.cc:2781] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:45.116801 2879 raft_consensus.cc:482] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:45.116853 2879 raft_consensus.cc:3037] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:45.117908 2879 raft_consensus.cc:504] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:45.118217 2879 leader_election.cc:288] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [CANDIDATE]: Term 1 election: Requested vote from peers 01985ef7ecf64f81b0223c3a75059cc7 (127.1.81.195:41759), b85410b2793f4e5a9c16fa81f2a3f7b8 (127.1.81.193:35695)
I20260809 02:20:45.118562 2780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c3a2fef5994e439ad2e830170ba865" candidate_uuid: "9110ce4c758049429e6f61fd26599184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01985ef7ecf64f81b0223c3a75059cc7"
I20260809 02:20:45.118595 2404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c3a2fef5994e439ad2e830170ba865" candidate_uuid: "9110ce4c758049429e6f61fd26599184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8"
I20260809 02:20:45.118687 2780 raft_consensus.cc:3037] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:45.118729 2404 raft_consensus.cc:3037] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:45.119735 2780 raft_consensus.cc:2454] T 11c3a2fef5994e439ad2e830170ba865 P 01985ef7ecf64f81b0223c3a75059cc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9110ce4c758049429e6f61fd26599184 in term 1.
I20260809 02:20:45.119776 2404 raft_consensus.cc:2454] T 11c3a2fef5994e439ad2e830170ba865 P b85410b2793f4e5a9c16fa81f2a3f7b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9110ce4c758049429e6f61fd26599184 in term 1.
I20260809 02:20:45.120048 2496 leader_election.cc:302] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01985ef7ecf64f81b0223c3a75059cc7, 9110ce4c758049429e6f61fd26599184; no voters:
I20260809 02:20:45.120227 2879 raft_consensus.cc:2781] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:45.120440 2879 raft_consensus.cc:686] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [term 1 LEADER]: Becoming Leader. State: Replica: 9110ce4c758049429e6f61fd26599184, State: Running, Role: LEADER
I20260809 02:20:45.120765 2879 consensus_queue.cc:237] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } }
I20260809 02:20:45.123669 2194 catalog_manager.cc:5495] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9110ce4c758049429e6f61fd26599184 (127.1.81.194). New cstate: current_term: 1 leader_uuid: "9110ce4c758049429e6f61fd26599184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01985ef7ecf64f81b0223c3a75059cc7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85410b2793f4e5a9c16fa81f2a3f7b8" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 35695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9110ce4c758049429e6f61fd26599184" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37091 } health_report { overall_health: HEALTHY } } }
W20260809 02:20:45.134063 2661 tablet.cc:2369] T 11c3a2fef5994e439ad2e830170ba865 P 9110ce4c758049429e6f61fd26599184: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 02:20:45 dist-test-slave-jlzn krb5kdc[2121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:20:45.146443 2870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:45.138912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48704 (local address 127.1.81.193:35695)
0809 02:20:45.139042 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:45.139047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:45.139207 (+ 160us) server_negotiation.cc:407] Connection header received
0809 02:20:45.139300 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:45.139302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:45.139338 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:45.139398 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:45.140028 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.140484 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.141226 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.141419 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.141485 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:45.143697 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:45.143707 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:45.143719 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:45.143742 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:45.145108 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:45.145465 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:45.145469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:45.145470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:45.145552 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:45.145741 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:45.145743 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:45.145744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:45.145953 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:45.146096 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:45.146211 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 02:20:45.146301 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 02:20:45 dist-test-slave-jlzn krb5kdc[2121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242045, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:20:45 dist-test-slave-jlzn krb5kdc[2121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242045, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:20:45.172091 2870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:45.164687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48716 (local address 127.1.81.193:35695)
0809 02:20:45.164810 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:45.164814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:45.164919 (+ 105us) server_negotiation.cc:407] Connection header received
0809 02:20:45.165056 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:45.165059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:45.165097 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:45.165157 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:45.165788 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.166262 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.167049 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.167256 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.167341 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:45.169416 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:45.169419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:45.169421 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:45.169442 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:45.170555 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:45.170927 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:45.170931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:45.170932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:45.171009 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:45.171261 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:45.171264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:45.171266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:45.171418 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:45.171545 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:45.171835 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 02:20:45.171946 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 02:20:45 dist-test-slave-jlzn krb5kdc[2121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:20:45 dist-test-slave-jlzn krb5kdc[2121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:20:45.196511 2870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:45.189058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48720 (local address 127.1.81.193:35695)
0809 02:20:45.189182 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:45.189187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:45.189301 (+ 114us) server_negotiation.cc:407] Connection header received
0809 02:20:45.189416 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:45.189419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:45.189457 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:45.189520 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:45.190156 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.190620 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.191521 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:45.191741 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:45.191852 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:45.193924 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:45.193927 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:45.193928 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:45.193951 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:45.194973 (+ 1022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:45.195347 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:45.195350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:45.195351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:45.195425 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:45.195673 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:45.195705 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:45.195707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:45.195925 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:45.196049 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:45.196264 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 02:20:45.196368 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 02:20:45.197820 2343 tablet_service.cc:2908] Rejecting scan request for tablet 11c3a2fef5994e439ad2e830170ba865: Uninitialized: clean time has not yet been initialized
I20260809 02:20:45.199741 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2281
I20260809 02:20:45.231302 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2478
I20260809 02:20:45.254612 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2665
I20260809 02:20:45.261258 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2143
2026-08-09T02:20:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2487 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:45 dist-test-slave-jlzn krb5kdc[2905](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:45 dist-test-slave-jlzn krb5kdc[2905](info): set up 2 sockets
Aug 09 02:20:45 dist-test-slave-jlzn krb5kdc[2905](info): commencing operation
krb5kdc: starting...
W20260809 02:20:46.383038 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:20:46 dist-test-slave-jlzn krb5kdc[2905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:20:46.493939 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:45623
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:45623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:46.599936 2925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:46.600147 2925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:46.600194 2925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:46.604015 2925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:46.604058 2925 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:20:46.604074 2925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:46.604106 2925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:46.604133 2925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:46.604158 2925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:46.609105 2925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:45623
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:45623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:46.609970 2925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:46.610859 2925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:46.618755 2933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:46.618816 2932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:46.618863 2925 server_base.cc:1034] running on GCE node
W20260809 02:20:46.618782 2936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:46.619472 2925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:46.620492 2925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:46.621635 2925 hybrid_clock.cc:648] HybridClock initialized: now 1786242046621619 us; error 31 us; skew 500 ppm
Aug 09 02:20:46 dist-test-slave-jlzn krb5kdc[2905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242046, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:46.624228 2925 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:20:46.624994 2925 webserver.cc:460] Webserver started at http://127.1.81.254:39343/ using document root <none> and password file <none>
I20260809 02:20:46.625478 2925 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:46.625548 2925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:46.625851 2925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:46.627727 2925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "9d127f0d9eb94931bd9103722290d887"
format_stamp: "Formatted at 2026-08-09 02:20:46 on dist-test-slave-jlzn"
server_key: "7b2c7e87e46e08de395785f69c649168"
server_key_iv: "a000ece62b79e9c1c130c7890c3f33d4"
server_key_version: "encryptionkey@0"
I20260809 02:20:46.628293 2925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "9d127f0d9eb94931bd9103722290d887"
format_stamp: "Formatted at 2026-08-09 02:20:46 on dist-test-slave-jlzn"
server_key: "7b2c7e87e46e08de395785f69c649168"
server_key_iv: "a000ece62b79e9c1c130c7890c3f33d4"
server_key_version: "encryptionkey@0"
I20260809 02:20:46.631546 2925 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:20:46.633725 2945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:46.634771 2925 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:20:46.634878 2925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "9d127f0d9eb94931bd9103722290d887"
format_stamp: "Formatted at 2026-08-09 02:20:46 on dist-test-slave-jlzn"
server_key: "7b2c7e87e46e08de395785f69c649168"
server_key_iv: "a000ece62b79e9c1c130c7890c3f33d4"
server_key_version: "encryptionkey@0"
I20260809 02:20:46.634963 2925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:46.691699 2925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:46.694681 2925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:46.694849 2925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:46.702540 2925 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:45623
I20260809 02:20:46.702555 3045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:45623 every 8 connection(s)
I20260809 02:20:46.703385 2925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:46.706001 3046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:46.709323 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2925
I20260809 02:20:46.709436 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:20:46.709697 1351 external_mini_cluster.cc:1428] Setting key 510654adce4422f4137dafdcb64ebb42
I20260809 02:20:46.711732 3046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887: Bootstrap starting.
I20260809 02:20:46.714092 3046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:46.714864 3046 log.cc:824] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:46.716837 3046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887: No bootstrap required, opened a new log
Aug 09 02:20:46 dist-test-slave-jlzn krb5kdc[2905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:46.720544 3046 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d127f0d9eb94931bd9103722290d887" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45623 } }
I20260809 02:20:46.720815 3046 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:46.720877 3046 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d127f0d9eb94931bd9103722290d887, State: Initialized, Role: FOLLOWER
I20260809 02:20:46.721289 3046 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d127f0d9eb94931bd9103722290d887" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45623 } }
I20260809 02:20:46.721410 3046 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:46.721467 3046 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:46.721560 3046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:46.722397 3046 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d127f0d9eb94931bd9103722290d887" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45623 } }
I20260809 02:20:46.722707 3046 leader_election.cc:302] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d127f0d9eb94931bd9103722290d887; no voters:
I20260809 02:20:46.722981 3046 leader_election.cc:288] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:46.723083 3057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:46.723078 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:46.710945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55444 (local address 127.1.81.254:45623)
0809 02:20:46.711310 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:46.711326 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:46.711360 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:20:46.712065 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:46.712085 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:46.712378 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:46.712639 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:46.713471 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.714462 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.715534 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.716014 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.716139 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:46.718763 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:46.718769 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:46.718779 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:46.718804 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:46.720320 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:46.720773 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:46.720777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:46.720781 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:46.720918 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:46.721185 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:46.721189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:46.721190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:46.721608 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:46.721793 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:46.722078 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 02:20:46.722330 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":109,"threads_started":1}
I20260809 02:20:46.723315 3057 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [term 1 LEADER]: Becoming Leader. State: Replica: 9d127f0d9eb94931bd9103722290d887, State: Running, Role: LEADER
I20260809 02:20:46.723605 3057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d127f0d9eb94931bd9103722290d887" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45623 } }
I20260809 02:20:46.724123 3046 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:46.725986 3058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d127f0d9eb94931bd9103722290d887. Latest consensus state: current_term: 1 leader_uuid: "9d127f0d9eb94931bd9103722290d887" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d127f0d9eb94931bd9103722290d887" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45623 } } }
I20260809 02:20:46.726104 3058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:46.726466 3060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d127f0d9eb94931bd9103722290d887" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d127f0d9eb94931bd9103722290d887" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45623 } } }
I20260809 02:20:46.726751 3060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887 [sys.catalog]: This master's current role is: LEADER
W20260809 02:20:46.728547 3079 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:20:46.728621 3079 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:20:46.728696 3077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:46.729326 3077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:46.734809 3077 catalog_manager.cc:1347] Generated new cluster ID: 499552d262b34c5cb9eaed9894bf7d18
I20260809 02:20:46.734869 3077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:46.762796 3077 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:46.763659 3077 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:46.770201 3077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887: Generated new TSK 0
I20260809 02:20:46.770875 3077 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:20:46.796448 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45623
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:46.904910 3089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:46.905140 3089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:46.905200 3089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:46.909003 3089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:46.909049 3089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:46.909108 3089 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:20:46.909159 3089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:20:46.914016 3089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:46.914866 3089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:46.915753 3089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:46.924391 3094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:46.924398 3096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:46.924588 3098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:46.924726 3089 server_base.cc:1034] running on GCE node
I20260809 02:20:46.925098 3089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:46.925726 3089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:46.926882 3089 hybrid_clock.cc:648] HybridClock initialized: now 1786242046926863 us; error 29 us; skew 500 ppm
Aug 09 02:20:46 dist-test-slave-jlzn krb5kdc[2905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242046, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:46.929366 3089 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:20:46.930110 3089 webserver.cc:460] Webserver started at http://127.1.81.193:43473/ using document root <none> and password file <none>
I20260809 02:20:46.930603 3089 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:46.930666 3089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:46.930840 3089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:46.932749 3089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "06f1ddf95f3f461a97fc69a2e33170ca"
format_stamp: "Formatted at 2026-08-09 02:20:46 on dist-test-slave-jlzn"
server_key: "c7295203e8eecac60e66d725f32636ec"
server_key_iv: "98656bde8f358ad6071ceb7b99916e1c"
server_key_version: "encryptionkey@0"
I20260809 02:20:46.933274 3089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "06f1ddf95f3f461a97fc69a2e33170ca"
format_stamp: "Formatted at 2026-08-09 02:20:46 on dist-test-slave-jlzn"
server_key: "c7295203e8eecac60e66d725f32636ec"
server_key_iv: "98656bde8f358ad6071ceb7b99916e1c"
server_key_version: "encryptionkey@0"
I20260809 02:20:46.936628 3089 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:46.938851 3105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:46.939954 3089 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:46.940059 3089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "06f1ddf95f3f461a97fc69a2e33170ca"
format_stamp: "Formatted at 2026-08-09 02:20:46 on dist-test-slave-jlzn"
server_key: "c7295203e8eecac60e66d725f32636ec"
server_key_iv: "98656bde8f358ad6071ceb7b99916e1c"
server_key_version: "encryptionkey@0"
I20260809 02:20:46.940145 3089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:46.973171 3089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:46.975605 3089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:46.975767 3089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:46.977110 3089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:46.977178 3089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:46.977239 3089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:46.977263 3089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:20:46 dist-test-slave-jlzn krb5kdc[2905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242046, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:46.987421 3089 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:42857
I20260809 02:20:46.987501 3286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:42857 every 8 connection(s)
I20260809 02:20:46.988351 3089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:46.990259 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:46.977802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:50251 (local address 127.1.81.254:45623)
0809 02:20:46.977912 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:46.977915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:46.978887 (+ 972us) server_negotiation.cc:407] Connection header received
0809 02:20:46.979770 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:46.979774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:46.979856 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:46.979928 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:46.981213 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.981770 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.982923 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.983165 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.983253 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:46.986702 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:46.986705 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:46.986707 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:46.986733 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:46.988183 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:46.988743 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:46.988747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:46.988748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:46.988843 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:46.989243 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:46.989245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:46.989246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:46.989423 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:46.989500 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:46.989972 (+ 472us) server_negotiation.cc:299] Negotiation successful
0809 02:20:46.990085 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:20:46.990878 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:46.978293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45623 (local address 127.1.81.193:50251)
0809 02:20:46.978756 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:46.978796 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:46.979580 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:46.980117 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:46.980126 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:46.980497 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:46.981053 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:46.981073 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.981882 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.981885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:46.982811 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:46.982821 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.983297 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.983301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:46.983463 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:46.984032 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:46.984051 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:46.986541 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:46.988290 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:46.988296 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:46.988308 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:46.988630 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:46.988942 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:46.988945 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:46.988947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:46.989107 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:46.989508 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:46.989512 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:46.989771 (+ 259us) client_negotiation.cc:769] Sending connection context
0809 02:20:46.989915 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 02:20:46.990150 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":134,"threads_started":1}
I20260809 02:20:46.992014 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 3089
I20260809 02:20:46.992033 3288 heartbeater.cc:347] Connected to a master server at 127.1.81.254:45623
I20260809 02:20:46.992125 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:46.992154 3288 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:46.992409 1351 external_mini_cluster.cc:1428] Setting key ed037829c2c4e0ec244cfd0fd90c1cc6
I20260809 02:20:46.992558 3288 heartbeater.cc:511] Master 127.1.81.254:45623 requested a full tablet report, sending...
I20260809 02:20:46.994688 2977 ts_manager.cc:194] Registered new tserver with Master: 06f1ddf95f3f461a97fc69a2e33170ca (127.1.81.193:42857)
I20260809 02:20:46.996057 2977 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:50251
I20260809 02:20:47.001303 3295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:46.994239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45623 (local address 127.1.81.193:52765)
0809 02:20:46.994485 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:46.994496 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:46.994585 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:46.994800 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:46.994803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:46.994971 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:46.995065 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:46.995070 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.996144 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.996147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:46.996910 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:46.996922 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.997464 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.997468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:46.997552 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:46.997984 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:46.997999 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:46.998377 (+ 378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:47.000043 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.000046 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.000047 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.000226 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.000496 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.000498 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.000499 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.000557 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.000940 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:47.000942 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:47.001011 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.001081 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.001174 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":86,"threads_started":1}
I20260809 02:20:47.001408 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:46.994171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:52765 (local address 127.1.81.254:45623)
0809 02:20:46.994271 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:46.994274 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:46.994563 (+ 289us) server_negotiation.cc:407] Connection header received
0809 02:20:46.994670 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:46.994673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:46.994712 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:46.994774 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:46.995170 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.996005 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.997047 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:46.997348 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:46.997443 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:46.998518 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:46.998522 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:46.998525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:46.998547 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:46.999944 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.000315 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.000319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.000320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.000412 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.000646 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.000656 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.000657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.000858 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:47.000952 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.001152 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.001260 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":225,"server-negotiator.queue_time_us":36}
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:20:47.018424 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45623
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:47.124667 3299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:47.124912 3299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:47.124971 3299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:47.128917 3299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:47.128966 3299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:47.129019 3299 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:20:47.129073 3299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:20:47.134023 3299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:47.134892 3299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:47.135776 3299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:47.144893 3309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:47.144966 3306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:47.144893 3305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:47.145193 3299 server_base.cc:1034] running on GCE node
I20260809 02:20:47.145504 3299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:47.146029 3299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:47.147183 3299 hybrid_clock.cc:648] HybridClock initialized: now 1786242047147162 us; error 30 us; skew 500 ppm
Aug 09 02:20:47 dist-test-slave-jlzn krb5kdc[2905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:47.149786 3299 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:20:47.150537 3299 webserver.cc:460] Webserver started at http://127.1.81.194:42135/ using document root <none> and password file <none>
I20260809 02:20:47.151003 3299 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:47.151057 3299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:47.151221 3299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:47.153097 3299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "a63c18467b0d4c08908d0b92cd8899d7"
format_stamp: "Formatted at 2026-08-09 02:20:47 on dist-test-slave-jlzn"
server_key: "afe01be721fa526f4d82764df72e484c"
server_key_iv: "b4b7c224cdf423b56ae34988363e4fb6"
server_key_version: "encryptionkey@0"
I20260809 02:20:47.153589 3299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "a63c18467b0d4c08908d0b92cd8899d7"
format_stamp: "Formatted at 2026-08-09 02:20:47 on dist-test-slave-jlzn"
server_key: "afe01be721fa526f4d82764df72e484c"
server_key_iv: "b4b7c224cdf423b56ae34988363e4fb6"
server_key_version: "encryptionkey@0"
I20260809 02:20:47.156937 3299 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:47.159150 3320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:47.160295 3299 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:47.160394 3299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "a63c18467b0d4c08908d0b92cd8899d7"
format_stamp: "Formatted at 2026-08-09 02:20:47 on dist-test-slave-jlzn"
server_key: "afe01be721fa526f4d82764df72e484c"
server_key_iv: "b4b7c224cdf423b56ae34988363e4fb6"
server_key_version: "encryptionkey@0"
I20260809 02:20:47.160485 3299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:47.177973 3299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:47.180382 3299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:47.180536 3299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:47.181806 3299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:47.181854 3299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:47.181890 3299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:47.181917 3299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:20:47 dist-test-slave-jlzn krb5kdc[2905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:47.191663 3299 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:39861
I20260809 02:20:47.191741 3492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:39861 every 8 connection(s)
I20260809 02:20:47.192659 3299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:20:47.193640 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 3299
I20260809 02:20:47.193740 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:47.193946 1351 external_mini_cluster.cc:1428] Setting key 85ca31cd0bd0784567a85c67dd046266
I20260809 02:20:47.196105 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.182524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:37769 (local address 127.1.81.254:45623)
0809 02:20:47.182683 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.182689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.183407 (+ 718us) server_negotiation.cc:407] Connection header received
0809 02:20:47.184394 (+ 987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.184398 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.184455 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.184512 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:47.186066 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.186862 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.188606 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.188941 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.189026 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.191746 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:47.191751 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:47.191754 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:47.191779 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:47.193371 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.194620 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.194624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.194626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.194712 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.195038 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.195041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.195043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.195266 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:47.195370 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.195834 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.195952 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:20:47.196764 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.182823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45623 (local address 127.1.81.194:37769)
0809 02:20:47.183259 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.183307 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.184172 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.184914 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.184924 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.185347 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:47.185924 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.185944 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.187034 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.187038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.188472 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.188485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.189096 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.189101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.189303 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.189885 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:47.189905 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:47.191581 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:47.194267 (+ 2686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.194272 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.194282 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.194514 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.194798 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.194801 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.194803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.194946 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.195380 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:47.195385 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:47.195587 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.195735 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.195995 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":104,"threads_started":1}
I20260809 02:20:47.198031 3493 heartbeater.cc:347] Connected to a master server at 127.1.81.254:45623
I20260809 02:20:47.198189 3493 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:47.198712 3493 heartbeater.cc:511] Master 127.1.81.254:45623 requested a full tablet report, sending...
I20260809 02:20:47.199770 2976 ts_manager.cc:194] Registered new tserver with Master: a63c18467b0d4c08908d0b92cd8899d7 (127.1.81.194:39861)
I20260809 02:20:47.200536 2976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:37769
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
I20260809 02:20:47.206372 3503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.200020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45623 (local address 127.1.81.194:54447)
0809 02:20:47.200324 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.200338 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.200429 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.200625 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.200628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.200831 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:47.200950 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.200958 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.201713 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.201715 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.202307 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.202315 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.202728 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.202731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.202821 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.203234 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:47.203248 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:47.203638 (+ 390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:47.205147 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.205150 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.205151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.205358 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.205587 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.205589 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.205590 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.205673 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.205964 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:47.205966 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:47.206032 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.206099 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.206194 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":2,"thread_start_us":95,"threads_started":1}
I20260809 02:20:47.206380 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.200073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:54447 (local address 127.1.81.254:45623)
0809 02:20:47.200179 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.200182 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.200396 (+ 214us) server_negotiation.cc:407] Connection header received
0809 02:20:47.200495 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.200498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.200536 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.200600 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:47.201079 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.201568 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.202417 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.202629 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.202712 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.203774 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:47.203778 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:47.203780 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:47.203828 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:47.205048 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.205453 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.205455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.205456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.205523 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.205726 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.205728 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.205729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.205901 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:47.205970 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.206135 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.206246 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:20:47.220311 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45623
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:47.332585 3507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:47.332796 3507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:47.332842 3507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:47.336699 3507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:47.336746 3507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:47.336790 3507 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:20:47.336841 3507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:20:47.341972 3507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:47.342873 3507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:47.343775 3507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:20:47.352900 3507 server_base.cc:1034] running on GCE node
W20260809 02:20:47.352880 3515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:47.352852 3514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:47.352854 3518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:47.353380 3507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:47.353946 3507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:47.355106 3507 hybrid_clock.cc:648] HybridClock initialized: now 1786242047355086 us; error 31 us; skew 500 ppm
Aug 09 02:20:47 dist-test-slave-jlzn krb5kdc[2905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:47.357640 3507 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:20:47.358400 3507 webserver.cc:460] Webserver started at http://127.1.81.195:36739/ using document root <none> and password file <none>
I20260809 02:20:47.358928 3507 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:47.359012 3507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:47.359211 3507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:47.361086 3507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "f4bee5dbb757419eb9a53b53b9e8d486"
format_stamp: "Formatted at 2026-08-09 02:20:47 on dist-test-slave-jlzn"
server_key: "23e0e23895ec2e94246c23117fabcadb"
server_key_iv: "cac4ef17c403f7f7325495da952c9cc2"
server_key_version: "encryptionkey@0"
I20260809 02:20:47.361616 3507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "f4bee5dbb757419eb9a53b53b9e8d486"
format_stamp: "Formatted at 2026-08-09 02:20:47 on dist-test-slave-jlzn"
server_key: "23e0e23895ec2e94246c23117fabcadb"
server_key_iv: "cac4ef17c403f7f7325495da952c9cc2"
server_key_version: "encryptionkey@0"
I20260809 02:20:47.365049 3507 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:47.367215 3530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:47.368307 3507 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:47.368412 3507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "f4bee5dbb757419eb9a53b53b9e8d486"
format_stamp: "Formatted at 2026-08-09 02:20:47 on dist-test-slave-jlzn"
server_key: "23e0e23895ec2e94246c23117fabcadb"
server_key_iv: "cac4ef17c403f7f7325495da952c9cc2"
server_key_version: "encryptionkey@0"
I20260809 02:20:47.368498 3507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:47.379082 3507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:47.381481 3507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:47.381637 3507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:47.382896 3507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:47.382944 3507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:47.382994 3507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:47.383021 3507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:20:47 dist-test-slave-jlzn krb5kdc[2905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242047, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:47.392402 3507 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:43283
I20260809 02:20:47.392452 3688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:43283 every 8 connection(s)
I20260809 02:20:47.393342 3507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:20:47.395352 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 3507
I20260809 02:20:47.395433 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:47.395706 1351 external_mini_cluster.cc:1428] Setting key 09cac812bfc604be0e46093b5581e0f1
I20260809 02:20:47.396736 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.383587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:55677 (local address 127.1.81.254:45623)
0809 02:20:47.383751 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.383757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.384517 (+ 760us) server_negotiation.cc:407] Connection header received
0809 02:20:47.385534 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.385538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.385597 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.385654 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:47.387299 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.388139 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.389733 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.390066 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.390195 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.392987 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:47.392990 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:47.392993 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:47.393024 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:47.394651 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.395091 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.395093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.395095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.395168 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.395514 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.395517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.395519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.395771 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:47.395897 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.396442 (+ 545us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.396566 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:20:47.397575 3539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.383939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45623 (local address 127.1.81.195:55677)
0809 02:20:47.384362 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.384408 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.385288 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.386054 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.386063 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.386513 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:47.387127 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.387158 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.388284 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.388288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.389602 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.389614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.390215 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.390217 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.390348 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.390946 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:47.390968 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:47.392795 (+ 1827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:47.394761 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.394766 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.394776 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.395016 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.395257 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.395261 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.395263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.395401 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.395907 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:47.395912 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:47.396184 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.396376 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.396666 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":97,"threads_started":1}
I20260809 02:20:47.398619 3689 heartbeater.cc:347] Connected to a master server at 127.1.81.254:45623
I20260809 02:20:47.398765 3689 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:47.399256 3689 heartbeater.cc:511] Master 127.1.81.254:45623 requested a full tablet report, sending...
I20260809 02:20:47.400251 2977 ts_manager.cc:194] Registered new tserver with Master: f4bee5dbb757419eb9a53b53b9e8d486 (127.1.81.195:43283)
I20260809 02:20:47.400893 2977 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:55677
I20260809 02:20:47.406667 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.400635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45623 (local address 127.1.81.195:37121)
0809 02:20:47.401001 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.401015 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.401107 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.401348 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.401351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.401526 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:47.401627 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.401633 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.402579 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.402581 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.403139 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.403146 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.403517 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.403519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.403581 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.404047 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:47.404059 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:47.404335 (+ 276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:47.405585 (+ 1250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.405587 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.405589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.405777 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.405969 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.405971 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.405972 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.406036 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.406305 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:47.406307 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:47.406376 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.406444 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.406538 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":92,"threads_started":1}
I20260809 02:20:47.406672 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.400735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:37121 (local address 127.1.81.254:45623)
0809 02:20:47.400840 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.400844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.401074 (+ 230us) server_negotiation.cc:407] Connection header received
0809 02:20:47.401207 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.401210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.401256 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.401313 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:47.401741 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.402471 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.403233 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.403436 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.403511 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.404432 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:47.404435 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:47.404437 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:47.404454 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:47.405498 (+ 1044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.405847 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.405849 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.405850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.405911 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.406092 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.406094 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.406095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.406245 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:47.406311 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.406485 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.406565 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:20:47.409286 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:20:47 dist-test-slave-jlzn krb5kdc[2905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242047, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:20:47 dist-test-slave-jlzn krb5kdc[2905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242047, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:47.433787 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.426656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55454 (local address 127.1.81.254:45623)
0809 02:20:47.426782 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.426785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.426796 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:20:47.426826 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.426828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.426861 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.426924 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:47.427570 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.428099 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.428903 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.429107 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.429198 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.431225 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:47.431228 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:47.431230 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:47.431252 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:47.432331 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.432692 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.432696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.432697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.432770 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.433020 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.433023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.433025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.433193 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:47.433309 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.433542 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.433647 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:20:47.436260 2977 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:20:47.439208 2977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:47.452733 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.447100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55874 (local address 127.1.81.193:42857)
0809 02:20:47.447360 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.447376 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.447400 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:20:47.447796 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.447823 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.448034 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.448200 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:47.448658 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.449784 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.451293 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.452119 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.452230 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.452391 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.452540 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.452615 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":78,"threads_started":1}
I20260809 02:20:47.452965 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.447641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:39861 (local address 127.0.0.1:54546)
0809 02:20:47.448478 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.448489 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.448558 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.449194 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.449197 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.449215 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:47.449296 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.449301 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.450570 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.450573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.451519 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.451526 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.452601 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.452605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.452693 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.452716 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.452791 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.452860 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"thread_start_us":90,"threads_started":1}
I20260809 02:20:47.453070 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.447856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54546 (local address 127.1.81.194:39861)
0809 02:20:47.448807 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.448818 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.448839 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:20:47.448911 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.448916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.449080 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.449216 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:47.449387 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.450446 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.451638 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.452286 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.452385 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.452541 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.452847 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.452945 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":845,"thread_start_us":97,"threads_started":1}
I20260809 02:20:47.453347 3718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.447628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:43283 (local address 127.0.0.1:54724)
0809 02:20:47.448223 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.448237 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.448325 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.448928 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.448931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.448949 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:47.449037 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.449043 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.450040 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.450043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.451170 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.451182 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.452998 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.453001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.453086 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.453108 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.453182 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.453247 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":29,"thread_start_us":95,"threads_started":1}
I20260809 02:20:47.453713 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.447961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.1.81.195:43283)
0809 02:20:47.448407 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.448419 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.448440 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:20:47.448514 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.448519 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.448806 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.448938 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:47.449129 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.449935 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.451280 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.452125 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.452230 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.452391 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.453509 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.453597 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":128,"threads_started":1}
I20260809 02:20:47.454406 3716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.446925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:42857 (local address 127.0.0.1:55874)
0809 02:20:47.447238 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.447282 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.447395 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.448372 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.448378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.448402 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:47.448521 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.448528 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.449909 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.449912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.451163 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.451173 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.452251 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.452255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.452360 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.452403 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.452518 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.452636 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":24,"thread_start_us":67,"threads_started":1}
I20260809 02:20:47.455696 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 0c8d3ef2482f4fa0a7120bbd47962f51 (DEFAULT_TABLE table=test-table [id=fcd48dfa519d49118e2fe2169b06d23c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:47.455852 3596 tablet_service.cc:1467] Processing CreateTablet for tablet 0c8d3ef2482f4fa0a7120bbd47962f51 (DEFAULT_TABLE table=test-table [id=fcd48dfa519d49118e2fe2169b06d23c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:47.456770 3596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c8d3ef2482f4fa0a7120bbd47962f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.456771 3390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c8d3ef2482f4fa0a7120bbd47962f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.458721 3186 tablet_service.cc:1467] Processing CreateTablet for tablet 0c8d3ef2482f4fa0a7120bbd47962f51 (DEFAULT_TABLE table=test-table [id=fcd48dfa519d49118e2fe2169b06d23c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:47.459733 3186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c8d3ef2482f4fa0a7120bbd47962f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.463367 3722 tablet_bootstrap.cc:492] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: Bootstrap starting.
I20260809 02:20:47.465278 3723 tablet_bootstrap.cc:492] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: Bootstrap starting.
I20260809 02:20:47.465655 3722 tablet_bootstrap.cc:654] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.466529 3722 log.cc:824] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:47.466940 3725 tablet_bootstrap.cc:492] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Bootstrap starting.
I20260809 02:20:47.467324 3723 tablet_bootstrap.cc:654] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.468071 3723 log.cc:824] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:47.468906 3722 tablet_bootstrap.cc:492] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: No bootstrap required, opened a new log
I20260809 02:20:47.469043 3725 tablet_bootstrap.cc:654] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.469108 3722 ts_tablet_manager.cc:1397] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:20:47.469863 3725 log.cc:824] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:47.470350 3723 tablet_bootstrap.cc:492] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: No bootstrap required, opened a new log
I20260809 02:20:47.470546 3723 ts_tablet_manager.cc:1397] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:20:47.471958 3725 tablet_bootstrap.cc:492] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: No bootstrap required, opened a new log
I20260809 02:20:47.472136 3725 ts_tablet_manager.cc:1397] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:20:47.472942 3722 raft_consensus.cc:348] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.473202 3722 raft_consensus.cc:374] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.473258 3722 raft_consensus.cc:729] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63c18467b0d4c08908d0b92cd8899d7, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.473693 3722 consensus_queue.cc:260] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.473695 3723 raft_consensus.cc:348] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.473881 3723 raft_consensus.cc:374] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.473928 3723 raft_consensus.cc:729] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4bee5dbb757419eb9a53b53b9e8d486, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.474313 3723 consensus_queue.cc:260] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.474421 3493 heartbeater.cc:503] Master 127.1.81.254:45623 was elected leader, sending a full tablet report...
I20260809 02:20:47.474676 3722 ts_tablet_manager.cc:1428] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:20:47.475203 3723 ts_tablet_manager.cc:1428] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:20:47.475510 3689 heartbeater.cc:503] Master 127.1.81.254:45623 was elected leader, sending a full tablet report...
I20260809 02:20:47.475594 3725 raft_consensus.cc:348] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.475786 3725 raft_consensus.cc:374] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.475854 3725 raft_consensus.cc:729] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f1ddf95f3f461a97fc69a2e33170ca, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.476183 3725 consensus_queue.cc:260] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.476783 3288 heartbeater.cc:503] Master 127.1.81.254:45623 was elected leader, sending a full tablet report...
I20260809 02:20:47.478420 3725 ts_tablet_manager.cc:1428] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260809 02:20:47.489475 3289 tablet.cc:2369] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:47.549589 3740 raft_consensus.cc:482] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:47.549759 3740 raft_consensus.cc:504] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.550727 3740 leader_election.cc:288] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4bee5dbb757419eb9a53b53b9e8d486 (127.1.81.195:43283), a63c18467b0d4c08908d0b92cd8899d7 (127.1.81.194:39861)
I20260809 02:20:47.554322 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.551048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:43847 (local address 127.1.81.195:43283)
0809 02:20:47.551176 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.551181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.551261 (+ 80us) server_negotiation.cc:407] Connection header received
0809 02:20:47.551404 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.551406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.551447 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.551505 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:47.551775 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.552325 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.553388 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.553783 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.553887 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.553942 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.554139 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.554210 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:20:47.554435 3742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.550916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:39861 (local address 127.1.81.193:44173)
0809 02:20:47.551353 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.551364 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.551455 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.551702 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.551704 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.551721 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:47.551854 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.551861 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.552580 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.552584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.553354 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.553363 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.553978 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.553982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.554122 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.554148 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.554212 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.554279 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":213,"thread_start_us":80,"threads_started":1}
I20260809 02:20:47.554422 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.551036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:44173 (local address 127.1.81.194:39861)
0809 02:20:47.551231 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.551236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.551432 (+ 196us) server_negotiation.cc:407] Connection header received
0809 02:20:47.551568 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.551570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.551613 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.551678 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:47.551971 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.552474 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.553466 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.553867 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.553972 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.554026 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.554237 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.554306 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 02:20:47.554347 3741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.550916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:43283 (local address 127.1.81.193:43847)
0809 02:20:47.551177 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.551192 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.551304 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.551526 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.551528 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.551558 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:47.551671 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.551676 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.552429 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.552433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.553264 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.553274 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.553889 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.553893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.554004 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.554043 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.554107 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.554186 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":41,"thread_start_us":69,"threads_started":1}
I20260809 02:20:47.555052 3422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c8d3ef2482f4fa0a7120bbd47962f51" candidate_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63c18467b0d4c08908d0b92cd8899d7" is_pre_election: true
I20260809 02:20:47.555256 3621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c8d3ef2482f4fa0a7120bbd47962f51" candidate_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" is_pre_election: true
I20260809 02:20:47.555326 3422 raft_consensus.cc:2454] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f1ddf95f3f461a97fc69a2e33170ca in term 0.
I20260809 02:20:47.555500 3621 raft_consensus.cc:2454] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f1ddf95f3f461a97fc69a2e33170ca in term 0.
I20260809 02:20:47.555851 3116 leader_election.cc:302] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f1ddf95f3f461a97fc69a2e33170ca, a63c18467b0d4c08908d0b92cd8899d7; no voters:
I20260809 02:20:47.556110 3740 raft_consensus.cc:2781] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:47.556191 3740 raft_consensus.cc:482] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:47.556243 3740 raft_consensus.cc:3037] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:47.557258 3740 raft_consensus.cc:504] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.557564 3740 leader_election.cc:288] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [CANDIDATE]: Term 1 election: Requested vote from peers f4bee5dbb757419eb9a53b53b9e8d486 (127.1.81.195:43283), a63c18467b0d4c08908d0b92cd8899d7 (127.1.81.194:39861)
I20260809 02:20:47.557864 3422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c8d3ef2482f4fa0a7120bbd47962f51" candidate_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63c18467b0d4c08908d0b92cd8899d7"
I20260809 02:20:47.557964 3422 raft_consensus.cc:3037] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:47.559500 3422 raft_consensus.cc:2454] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f1ddf95f3f461a97fc69a2e33170ca in term 1.
I20260809 02:20:47.559751 3621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c8d3ef2482f4fa0a7120bbd47962f51" candidate_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4bee5dbb757419eb9a53b53b9e8d486"
I20260809 02:20:47.559778 3116 leader_election.cc:302] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f1ddf95f3f461a97fc69a2e33170ca, a63c18467b0d4c08908d0b92cd8899d7; no voters:
I20260809 02:20:47.559898 3621 raft_consensus.cc:3037] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:47.561074 3621 raft_consensus.cc:2454] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f1ddf95f3f461a97fc69a2e33170ca in term 1.
I20260809 02:20:47.561254 3740 raft_consensus.cc:2781] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:47.561421 3740 raft_consensus.cc:686] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 LEADER]: Becoming Leader. State: Replica: 06f1ddf95f3f461a97fc69a2e33170ca, State: Running, Role: LEADER
I20260809 02:20:47.561738 3740 consensus_queue.cc:237] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } }
I20260809 02:20:47.564772 2973 catalog_manager.cc:5495] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 06f1ddf95f3f461a97fc69a2e33170ca (127.1.81.193). New cstate: current_term: 1 leader_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } health_report { overall_health: UNKNOWN } } }
I20260809 02:20:47.607604 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.604085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55886 (local address 127.1.81.193:42857)
0809 02:20:47.604228 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.604232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.604246 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:20:47.604439 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.604442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.604498 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.604578 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:47.604839 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.605332 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.606213 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.606433 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.606516 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.606844 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:47.607210 (+ 366us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:47.607310 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.607415 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.607472 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:20:47.612941 3621 raft_consensus.cc:1261] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Refusing update from remote peer 06f1ddf95f3f461a97fc69a2e33170ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:47.612941 3422 raft_consensus.cc:1261] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Refusing update from remote peer 06f1ddf95f3f461a97fc69a2e33170ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:47.613595 3743 consensus_queue.cc:1035] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:47.613814 3740 consensus_queue.cc:1035] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:47.619522 3749 mvcc.cc:205] Tried to move back new op lower bound from 7316447427015667712 to 7316447426815205376. Current Snapshot: MvccSnapshot[applied={T|T < 7316447427015667712}]
I20260809 02:20:47.621456 3750 mvcc.cc:205] Tried to move back new op lower bound from 7316447427015667712 to 7316447426815205376. Current Snapshot: MvccSnapshot[applied={T|T < 7316447427015667712}]
I20260809 02:20:47.631402 2977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:47.631634 2977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:47.634021 2977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887: Sending DeleteTablet for 3 replicas of tablet 0c8d3ef2482f4fa0a7120bbd47962f51
I20260809 02:20:47.634790 3186 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c8d3ef2482f4fa0a7120bbd47962f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:47 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55874
I20260809 02:20:47.634837 3596 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c8d3ef2482f4fa0a7120bbd47962f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:47 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:54724
I20260809 02:20:47.634857 3390 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c8d3ef2482f4fa0a7120bbd47962f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:47 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:54546
I20260809 02:20:47.635316 3760 tablet_replica.cc:330] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: stopping tablet replica
I20260809 02:20:47.635321 2977 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 02:20:47.635607 3760 raft_consensus.cc:2229] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 LEADER]: Raft consensus shutting down.
W20260809 02:20:47.635715 2977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:47.636020 3760 raft_consensus.cc:2258] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:47.636493 3762 tablet_replica.cc:330] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: stopping tablet replica
I20260809 02:20:47.636772 3762 raft_consensus.cc:2229] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:47.637040 3762 raft_consensus.cc:2258] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:47.637385 3760 ts_tablet_manager.cc:1905] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:47.638845 3762 ts_tablet_manager.cc:1905] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:47.640259 3186 tablet_service.cc:1467] Processing CreateTablet for tablet a10227ac92d44f13b51095307ad925cc (DEFAULT_TABLE table=test-table [id=aa484a8070a547e68ce5ae3a46ecc375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:47.640439 3390 tablet_service.cc:1467] Processing CreateTablet for tablet a10227ac92d44f13b51095307ad925cc (DEFAULT_TABLE table=test-table [id=aa484a8070a547e68ce5ae3a46ecc375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:47.640524 3186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a10227ac92d44f13b51095307ad925cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.640657 3390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a10227ac92d44f13b51095307ad925cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.641520 3762 ts_tablet_manager.cc:1918] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:20:47.641624 3762 log.cc:1196] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/0c8d3ef2482f4fa0a7120bbd47962f51
I20260809 02:20:47.641949 3762 ts_tablet_manager.cc:1939] T 0c8d3ef2482f4fa0a7120bbd47962f51 P a63c18467b0d4c08908d0b92cd8899d7: Deleting consensus metadata
I20260809 02:20:47.642622 3725 tablet_bootstrap.cc:492] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: Bootstrap starting.
I20260809 02:20:47.643266 2953 catalog_manager.cc:4841] TS a63c18467b0d4c08908d0b92cd8899d7 (127.1.81.194:39861): tablet 0c8d3ef2482f4fa0a7120bbd47962f51 (table test-table [id=fcd48dfa519d49118e2fe2169b06d23c]) successfully deleted
I20260809 02:20:47.643311 3596 tablet_service.cc:1467] Processing CreateTablet for tablet a10227ac92d44f13b51095307ad925cc (DEFAULT_TABLE table=test-table [id=aa484a8070a547e68ce5ae3a46ecc375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:47.643563 3596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a10227ac92d44f13b51095307ad925cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.643596 3725 tablet_bootstrap.cc:654] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.644197 3722 tablet_bootstrap.cc:492] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: Bootstrap starting.
I20260809 02:20:47.645030 3722 tablet_bootstrap.cc:654] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.645212 3760 ts_tablet_manager.cc:1918] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:20:47.645301 3760 log.cc:1196] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/0c8d3ef2482f4fa0a7120bbd47962f51
I20260809 02:20:47.645579 3760 ts_tablet_manager.cc:1939] T 0c8d3ef2482f4fa0a7120bbd47962f51 P 06f1ddf95f3f461a97fc69a2e33170ca: Deleting consensus metadata
I20260809 02:20:47.645931 3723 tablet_bootstrap.cc:492] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: Bootstrap starting.
I20260809 02:20:47.646557 2949 catalog_manager.cc:4841] TS 06f1ddf95f3f461a97fc69a2e33170ca (127.1.81.193:42857): tablet 0c8d3ef2482f4fa0a7120bbd47962f51 (table test-table [id=fcd48dfa519d49118e2fe2169b06d23c]) successfully deleted
I20260809 02:20:47.646706 3725 tablet_bootstrap.cc:492] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: No bootstrap required, opened a new log
I20260809 02:20:47.646790 3725 ts_tablet_manager.cc:1397] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 02:20:47.646853 3723 tablet_bootstrap.cc:654] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.647156 3725 raft_consensus.cc:348] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.647244 3725 raft_consensus.cc:374] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.647274 3725 raft_consensus.cc:729] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f1ddf95f3f461a97fc69a2e33170ca, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.647387 3725 consensus_queue.cc:260] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.647650 3725 ts_tablet_manager.cc:1428] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:47.647962 3723 tablet_bootstrap.cc:492] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: No bootstrap required, opened a new log
I20260809 02:20:47.647962 3722 tablet_bootstrap.cc:492] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: No bootstrap required, opened a new log
I20260809 02:20:47.648043 3722 ts_tablet_manager.cc:1397] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 02:20:47.648043 3723 ts_tablet_manager.cc:1397] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:47.648448 3723 raft_consensus.cc:348] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.648448 3722 raft_consensus.cc:348] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.648552 3723 raft_consensus.cc:374] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.648552 3722 raft_consensus.cc:374] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.648584 3723 raft_consensus.cc:729] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4bee5dbb757419eb9a53b53b9e8d486, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.648584 3722 raft_consensus.cc:729] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63c18467b0d4c08908d0b92cd8899d7, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.648699 3722 consensus_queue.cc:260] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.648697 3723 consensus_queue.cc:260] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.648927 3723 ts_tablet_manager.cc:1428] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:47.648927 3722 ts_tablet_manager.cc:1428] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:47.650804 3761 tablet_replica.cc:330] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: stopping tablet replica
I20260809 02:20:47.651077 3761 raft_consensus.cc:2229] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:47.651366 3761 raft_consensus.cc:2258] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:47.656736 3761 ts_tablet_manager.cc:1905] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:47.658766 3761 ts_tablet_manager.cc:1918] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:20:47.658854 3761 log.cc:1196] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/0c8d3ef2482f4fa0a7120bbd47962f51
I20260809 02:20:47.659082 3761 ts_tablet_manager.cc:1939] T 0c8d3ef2482f4fa0a7120bbd47962f51 P f4bee5dbb757419eb9a53b53b9e8d486: Deleting consensus metadata
I20260809 02:20:47.660029 2949 catalog_manager.cc:4841] TS f4bee5dbb757419eb9a53b53b9e8d486 (127.1.81.195:43283): tablet 0c8d3ef2482f4fa0a7120bbd47962f51 (table test-table [id=fcd48dfa519d49118e2fe2169b06d23c]) successfully deleted
W20260809 02:20:47.693760 3494 tablet.cc:2369] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:47.880965 3737 raft_consensus.cc:482] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:47.881125 3737 raft_consensus.cc:504] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.882262 3737 leader_election.cc:288] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f1ddf95f3f461a97fc69a2e33170ca (127.1.81.193:42857), f4bee5dbb757419eb9a53b53b9e8d486 (127.1.81.195:43283)
I20260809 02:20:47.886842 3770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.882846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:43283 (local address 127.1.81.194:58669)
0809 02:20:47.883134 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.883146 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.883263 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.883484 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.883487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.883508 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:47.883589 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.883594 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.884495 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.884498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.885743 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.885755 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.886489 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.886492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.886576 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.886599 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.886656 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.886716 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":40,"thread_start_us":71,"threads_started":1}
I20260809 02:20:47.886888 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.882960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:58669 (local address 127.1.81.195:43283)
0809 02:20:47.883078 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.883082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.883237 (+ 155us) server_negotiation.cc:407] Connection header received
0809 02:20:47.883352 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.883354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.883394 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.883462 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:47.883690 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.884411 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.885867 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.886386 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.886499 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.886556 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.886687 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.886760 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:20:47.887462 3621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10227ac92d44f13b51095307ad925cc" candidate_uuid: "a63c18467b0d4c08908d0b92cd8899d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" is_pre_election: true
I20260809 02:20:47.887606 3621 raft_consensus.cc:2454] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63c18467b0d4c08908d0b92cd8899d7 in term 0.
I20260809 02:20:47.887688 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.882471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:42857 (local address 127.1.81.194:51383)
0809 02:20:47.882763 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.882778 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.882900 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.883162 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.883165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.883188 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:47.883370 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.883377 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.884361 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.884363 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.885743 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.885755 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.887252 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.887256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.887364 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.887392 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.887462 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.887532 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":52,"spinlock_wait_cycles":72448,"thread_start_us":92,"threads_started":1}
I20260809 02:20:47.887683 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.882593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:51383 (local address 127.1.81.193:42857)
0809 02:20:47.882743 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.882748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.882864 (+ 116us) server_negotiation.cc:407] Connection header received
0809 02:20:47.883018 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.883021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.883074 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.883145 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:47.883471 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.884267 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.886568 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.887124 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.887247 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.887286 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.887499 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.887580 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:20:47.888105 3322 leader_election.cc:302] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63c18467b0d4c08908d0b92cd8899d7, f4bee5dbb757419eb9a53b53b9e8d486; no voters:
I20260809 02:20:47.888351 3737 raft_consensus.cc:2781] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:47.888420 3737 raft_consensus.cc:482] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:47.888459 3737 raft_consensus.cc:3037] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:47.888684 3220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10227ac92d44f13b51095307ad925cc" candidate_uuid: "a63c18467b0d4c08908d0b92cd8899d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" is_pre_election: true
I20260809 02:20:47.888888 3220 raft_consensus.cc:2454] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63c18467b0d4c08908d0b92cd8899d7 in term 0.
I20260809 02:20:47.889576 3737 raft_consensus.cc:504] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.889881 3737 leader_election.cc:288] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [CANDIDATE]: Term 1 election: Requested vote from peers 06f1ddf95f3f461a97fc69a2e33170ca (127.1.81.193:42857), f4bee5dbb757419eb9a53b53b9e8d486 (127.1.81.195:43283)
I20260809 02:20:47.890234 3220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10227ac92d44f13b51095307ad925cc" candidate_uuid: "a63c18467b0d4c08908d0b92cd8899d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f1ddf95f3f461a97fc69a2e33170ca"
I20260809 02:20:47.890264 3621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a10227ac92d44f13b51095307ad925cc" candidate_uuid: "a63c18467b0d4c08908d0b92cd8899d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4bee5dbb757419eb9a53b53b9e8d486"
I20260809 02:20:47.890355 3621 raft_consensus.cc:3037] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:47.890355 3220 raft_consensus.cc:3037] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:47.891433 3220 raft_consensus.cc:2454] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63c18467b0d4c08908d0b92cd8899d7 in term 1.
I20260809 02:20:47.891433 3621 raft_consensus.cc:2454] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63c18467b0d4c08908d0b92cd8899d7 in term 1.
I20260809 02:20:47.891716 3322 leader_election.cc:302] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f1ddf95f3f461a97fc69a2e33170ca, a63c18467b0d4c08908d0b92cd8899d7; no voters:
I20260809 02:20:47.891893 3737 raft_consensus.cc:2781] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:47.892056 3737 raft_consensus.cc:686] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 1 LEADER]: Becoming Leader. State: Replica: a63c18467b0d4c08908d0b92cd8899d7, State: Running, Role: LEADER
I20260809 02:20:47.892297 3737 consensus_queue.cc:237] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.894312 2973 catalog_manager.cc:5495] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a63c18467b0d4c08908d0b92cd8899d7 (127.1.81.194). New cstate: current_term: 1 leader_uuid: "a63c18467b0d4c08908d0b92cd8899d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } health_report { overall_health: UNKNOWN } } }
W20260809 02:20:47.896356 3690 tablet.cc:2369] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 02:20:47 dist-test-slave-jlzn krb5kdc[2905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242046, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:47.963953 3779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.949211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45623 (local address 127.0.0.1:55468)
0809 02:20:47.949472 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:47.949484 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:47.949562 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:47.949765 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:47.949768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:47.950197 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:47.950297 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.950303 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.950960 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.950962 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.951529 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:47.951549 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.951944 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.951947 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:47.952032 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.959908 (+ 7876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:47.959920 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:47.961257 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:47.962626 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.962635 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.962640 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.962859 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.963062 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:47.963065 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:47.963066 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:47.963136 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:47.963427 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:47.963432 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:47.963545 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 02:20:47.963629 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:20:47.963744 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":13,"thread_start_us":85,"threads_started":1}
I20260809 02:20:47.963967 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:47.949277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55468 (local address 127.1.81.254:45623)
0809 02:20:47.949515 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:47.949521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:47.949534 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:20:47.949631 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:47.949633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:47.949669 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:47.949739 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:47.950386 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.950888 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.951620 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:47.951868 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:47.951938 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:47.961386 (+ 9448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:47.961390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:47.961392 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:47.961413 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:47.962537 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.962932 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.962934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.962935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.963004 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:47.963203 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:47.963205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:47.963206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:47.963357 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:47.963426 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:47.963683 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 02:20:47.963820 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":179,"thread_start_us":95,"threads_started":1}
I20260809 02:20:47.967481 2973 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55468:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:20:47.968179 2973 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:47.972609 3186 tablet_service.cc:1467] Processing CreateTablet for tablet 3102103e9619438ea793a4f5562bccb5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8fb23c1b7c244c109abe914854dd212a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:20:47.972716 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 3102103e9619438ea793a4f5562bccb5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8fb23c1b7c244c109abe914854dd212a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:20:47.972733 3596 tablet_service.cc:1467] Processing CreateTablet for tablet 3102103e9619438ea793a4f5562bccb5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8fb23c1b7c244c109abe914854dd212a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:20:47.973026 3186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3102103e9619438ea793a4f5562bccb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.973070 3596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3102103e9619438ea793a4f5562bccb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.973114 3390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3102103e9619438ea793a4f5562bccb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:47.975603 3722 tablet_bootstrap.cc:492] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: Bootstrap starting.
I20260809 02:20:47.975739 3725 tablet_bootstrap.cc:492] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: Bootstrap starting.
I20260809 02:20:47.976542 3723 tablet_bootstrap.cc:492] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: Bootstrap starting.
I20260809 02:20:47.976579 3722 tablet_bootstrap.cc:654] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.976598 3725 tablet_bootstrap.cc:654] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.977423 3723 tablet_bootstrap.cc:654] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:47.977711 3725 tablet_bootstrap.cc:492] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: No bootstrap required, opened a new log
I20260809 02:20:47.977780 3722 tablet_bootstrap.cc:492] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: No bootstrap required, opened a new log
I20260809 02:20:47.977804 3725 ts_tablet_manager.cc:1397] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:20:47.977872 3722 ts_tablet_manager.cc:1397] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:47.978169 3725 raft_consensus.cc:348] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.978293 3725 raft_consensus.cc:374] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.978338 3725 raft_consensus.cc:729] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f1ddf95f3f461a97fc69a2e33170ca, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.978322 3722 raft_consensus.cc:348] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.978437 3722 raft_consensus.cc:374] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.978468 3722 raft_consensus.cc:729] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63c18467b0d4c08908d0b92cd8899d7, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.978466 3725 consensus_queue.cc:260] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.978577 3722 consensus_queue.cc:260] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.978753 3725 ts_tablet_manager.cc:1428] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:20:47.978817 3723 tablet_bootstrap.cc:492] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: No bootstrap required, opened a new log
I20260809 02:20:47.978826 3722 ts_tablet_manager.cc:1428] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:47.978895 3723 ts_tablet_manager.cc:1397] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:47.979008 3754 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:47.979048 3737 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:47.979137 3754 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:47.979169 3737 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:47.979341 3723 raft_consensus.cc:348] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.979439 3723 raft_consensus.cc:374] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:47.979467 3723 raft_consensus.cc:729] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4bee5dbb757419eb9a53b53b9e8d486, State: Initialized, Role: FOLLOWER
I20260809 02:20:47.979585 3723 consensus_queue.cc:260] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:47.979866 3723 ts_tablet_manager.cc:1428] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:47.979832 3739 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:47.979964 3739 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:48.245265 3739 raft_consensus.cc:482] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:48.245404 3739 raft_consensus.cc:504] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:48.246451 3739 leader_election.cc:288] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f1ddf95f3f461a97fc69a2e33170ca (127.1.81.193:42857), a63c18467b0d4c08908d0b92cd8899d7 (127.1.81.194:39861)
I20260809 02:20:48.251546 3788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.246816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:39449 (local address 127.1.81.194:39861)
0809 02:20:48.247022 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:48.247025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:48.247177 (+ 152us) server_negotiation.cc:407] Connection header received
0809 02:20:48.247274 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:48.247277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:48.247330 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:48.247413 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:48.247752 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.248604 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.250284 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.250918 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.251020 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.251067 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:48.251322 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 02:20:48.251393 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":59,"threads_started":1}
I20260809 02:20:48.251530 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.246751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:33541 (local address 127.1.81.193:42857)
0809 02:20:48.246896 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:48.246901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:48.247127 (+ 226us) server_negotiation.cc:407] Connection header received
0809 02:20:48.247276 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:48.247278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:48.247335 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:48.247417 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:48.247752 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.248593 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.250288 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.250890 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.251012 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.251067 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:48.251318 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 02:20:48.251399 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:20:48.251616 3785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.246723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:39861 (local address 127.1.81.195:39449)
0809 02:20:48.247093 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:48.247104 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:48.247187 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:48.247434 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:48.247437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:48.247483 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:48.247633 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.247639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.248701 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.248704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.250170 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.250183 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.251013 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.251016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.251175 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.251219 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:20:48.251290 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:20:48.251411 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":113,"spinlock_wait_cycles":43392,"thread_start_us":75,"threads_started":1}
I20260809 02:20:48.251616 3786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.246673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:42857 (local address 127.1.81.195:33541)
0809 02:20:48.247027 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:48.247041 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:48.247173 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:48.247434 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:48.247437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:48.247470 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:48.247625 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.247633 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.248696 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.248699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.250174 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.250183 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.251013 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.251016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.251156 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.251218 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 02:20:48.251294 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:20:48.251418 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":236,"thread_start_us":91,"threads_started":1}
I20260809 02:20:48.252111 3220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3102103e9619438ea793a4f5562bccb5" candidate_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" is_pre_election: true
I20260809 02:20:48.252254 3220 raft_consensus.cc:2454] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4bee5dbb757419eb9a53b53b9e8d486 in term 0.
I20260809 02:20:48.252399 3422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3102103e9619438ea793a4f5562bccb5" candidate_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63c18467b0d4c08908d0b92cd8899d7" is_pre_election: true
I20260809 02:20:48.252538 3422 raft_consensus.cc:2454] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4bee5dbb757419eb9a53b53b9e8d486 in term 0.
I20260809 02:20:48.252616 3532 leader_election.cc:302] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f1ddf95f3f461a97fc69a2e33170ca, f4bee5dbb757419eb9a53b53b9e8d486; no voters:
I20260809 02:20:48.252900 3739 raft_consensus.cc:2781] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:48.252969 3739 raft_consensus.cc:482] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:48.253012 3739 raft_consensus.cc:3037] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:48.253994 3739 raft_consensus.cc:504] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:48.254318 3739 leader_election.cc:288] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [CANDIDATE]: Term 1 election: Requested vote from peers 06f1ddf95f3f461a97fc69a2e33170ca (127.1.81.193:42857), a63c18467b0d4c08908d0b92cd8899d7 (127.1.81.194:39861)
I20260809 02:20:48.254630 3422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3102103e9619438ea793a4f5562bccb5" candidate_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63c18467b0d4c08908d0b92cd8899d7"
I20260809 02:20:48.254657 3220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3102103e9619438ea793a4f5562bccb5" candidate_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f1ddf95f3f461a97fc69a2e33170ca"
I20260809 02:20:48.254738 3422 raft_consensus.cc:3037] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:48.254766 3220 raft_consensus.cc:3037] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:48.255580 3422 raft_consensus.cc:2454] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4bee5dbb757419eb9a53b53b9e8d486 in term 1.
I20260809 02:20:48.255638 3220 raft_consensus.cc:2454] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4bee5dbb757419eb9a53b53b9e8d486 in term 1.
I20260809 02:20:48.255913 3534 leader_election.cc:302] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63c18467b0d4c08908d0b92cd8899d7, f4bee5dbb757419eb9a53b53b9e8d486; no voters:
I20260809 02:20:48.256100 3739 raft_consensus.cc:2781] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:48.256269 3739 raft_consensus.cc:686] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 LEADER]: Becoming Leader. State: Replica: f4bee5dbb757419eb9a53b53b9e8d486, State: Running, Role: LEADER
I20260809 02:20:48.256488 3739 consensus_queue.cc:237] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } }
I20260809 02:20:48.257661 3790 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: TxnStatusTablet state changed. Reason: New leader f4bee5dbb757419eb9a53b53b9e8d486. Latest consensus state: current_term: 1 leader_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:48.257769 3790 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:20:48.258214 3797 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:20:48.258363 3797 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:20:48.258723 2976 catalog_manager.cc:5495] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4bee5dbb757419eb9a53b53b9e8d486 (127.1.81.195). New cstate: current_term: 1 leader_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } health_report { overall_health: HEALTHY } } }
I20260809 02:20:48.292363 3737 consensus_queue.cc:1035] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:48.296211 3737 consensus_queue.cc:1035] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:48.337952 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.334268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54728 (local address 127.1.81.195:43283)
0809 02:20:48.334376 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:48.334380 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:48.334466 (+ 86us) server_negotiation.cc:407] Connection header received
0809 02:20:48.334647 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:48.334650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:48.334702 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:48.334781 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:48.334984 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.335471 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.336610 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.336810 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.336877 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.337179 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:48.337556 (+ 377us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:48.337642 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:48.337769 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 02:20:48.337817 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:20:48.338017 3779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.334183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:43283 (local address 127.0.0.1:54728)
0809 02:20:48.334412 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:48.334425 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:48.334529 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:48.334799 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:48.334802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:48.334808 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:20:48.334912 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.334917 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.335547 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.335550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.336508 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.336521 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.336899 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.336902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.336999 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.337052 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:20:48.337666 (+ 614us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:20:48.337683 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 02:20:48.337759 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:20:48.337850 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134}
I20260809 02:20:48.340871 3220 raft_consensus.cc:1261] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 FOLLOWER]: Refusing update from remote peer f4bee5dbb757419eb9a53b53b9e8d486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:48.340894 3422 raft_consensus.cc:1261] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Refusing update from remote peer f4bee5dbb757419eb9a53b53b9e8d486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:48.341305 3739 consensus_queue.cc:1035] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:48.341727 3739 consensus_queue.cc:1035] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:48.342710 3754 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: TxnStatusTablet state changed. Reason: New leader f4bee5dbb757419eb9a53b53b9e8d486. Latest consensus state: current_term: 1 leader_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:48.342823 3754 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:48.344444 3737 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: TxnStatusTablet state changed. Reason: New leader f4bee5dbb757419eb9a53b53b9e8d486. Latest consensus state: current_term: 1 leader_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:48.344542 3737 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:48.345464 3790 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:48.345577 3790 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:20:48.345706 3790 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:48.345778 3790 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P f4bee5dbb757419eb9a53b53b9e8d486: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:20:48.345850 3805 mvcc.cc:205] Tried to move back new op lower bound from 7316447429999038464 to 7316447429660590080. Current Snapshot: MvccSnapshot[applied={T|T < 7316447429999038464}]
I20260809 02:20:48.346613 3737 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:48.346719 3737 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P a63c18467b0d4c08908d0b92cd8899d7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:48.346985 3754 tablet_replica.cc:439] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f1ddf95f3f461a97fc69a2e33170ca" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 42857 } } peers { permanent_uuid: "a63c18467b0d4c08908d0b92cd8899d7" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39861 } } peers { permanent_uuid: "f4bee5dbb757419eb9a53b53b9e8d486" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43283 } } }
I20260809 02:20:48.347085 3754 tablet_replica.cc:442] T 3102103e9619438ea793a4f5562bccb5 P 06f1ddf95f3f461a97fc69a2e33170ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:48.355777 3788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.352016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54550 (local address 127.1.81.194:39861)
0809 02:20:48.352134 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:48.352146 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:48.352296 (+ 150us) server_negotiation.cc:407] Connection header received
0809 02:20:48.352419 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:48.352422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:48.352484 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:48.352590 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:48.352787 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.353559 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.354343 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.354692 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.354795 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.354970 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:48.355446 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:48.355555 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:48.355587 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 02:20:48.355646 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:20:48.366178 3829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.362321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:43283 (local address 127.1.81.194:37667)
0809 02:20:48.362593 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:48.362605 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:48.362690 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:48.362911 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:48.362913 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:48.362919 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:20:48.363014 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.363018 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.363902 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.363904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.365043 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.365054 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.365590 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.365592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.365650 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.365692 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:20:48.365942 (+ 250us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:20:48.365945 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:20:48.365982 (+ 37us) client_negotiation.cc:240] Negotiation successful
0809 02:20:48.366043 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":87,"threads_started":1}
I20260809 02:20:48.366185 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.362442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:37667 (local address 127.1.81.195:43283)
0809 02:20:48.362556 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:48.362559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:48.362676 (+ 117us) server_negotiation.cc:407] Connection header received
0809 02:20:48.362776 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:48.362779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:48.362828 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:48.362909 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:48.363102 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.363785 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.365166 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.365495 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.365597 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.365803 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:48.365876 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:48.365943 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:48.366007 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 02:20:48.366059 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:20:48.390885 3788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.387471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:34673 (local address 127.1.81.194:39861)
0809 02:20:48.387574 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:48.387578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:48.387592 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:20:48.387695 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:48.387698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:48.387741 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:48.387842 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:48.388094 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.388842 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.389833 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.390117 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.390189 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.390511 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:48.390589 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:48.390658 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:48.390719 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 02:20:48.390765 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:20:48.390897 3833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.387198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:39861 (local address 127.1.81.195:34673)
0809 02:20:48.387520 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:48.387536 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:48.387619 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:48.387858 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:48.387861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:48.387868 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:20:48.387994 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.388001 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.388941 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.388944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.389702 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:48.389712 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.390281 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.390283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:48.390354 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.390392 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:20:48.390664 (+ 272us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:20:48.390667 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:20:48.390708 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 02:20:48.390768 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":97,"threads_started":1}
I20260809 02:20:48.420648 2973 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:48.420827 2973 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:48.422798 2973 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d127f0d9eb94931bd9103722290d887: Sending DeleteTablet for 3 replicas of tablet a10227ac92d44f13b51095307ad925cc
I20260809 02:20:48.423388 3390 tablet_service.cc:1514] Processing DeleteTablet for tablet a10227ac92d44f13b51095307ad925cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:48 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:54546
I20260809 02:20:48.423394 3186 tablet_service.cc:1514] Processing DeleteTablet for tablet a10227ac92d44f13b51095307ad925cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:48 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55874
I20260809 02:20:48.423729 3839 tablet_replica.cc:330] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: stopping tablet replica
I20260809 02:20:48.423892 3839 raft_consensus.cc:2229] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:20:48.424198 3839 raft_consensus.cc:2258] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:48.424757 3596 tablet_service.cc:1514] Processing DeleteTablet for tablet a10227ac92d44f13b51095307ad925cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:48 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:54724
I20260809 02:20:48.424997 3839 ts_tablet_manager.cc:1905] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:48.425307 3842 tablet_replica.cc:330] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: stopping tablet replica
I20260809 02:20:48.425436 3842 raft_consensus.cc:2229] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:48.425551 3842 raft_consensus.cc:2258] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:48.425777 3845 tablet_replica.cc:330] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: stopping tablet replica
I20260809 02:20:48.425900 3845 raft_consensus.cc:2229] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:48.426015 3845 raft_consensus.cc:2258] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:48.426831 3842 ts_tablet_manager.cc:1905] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:48.428320 3839 ts_tablet_manager.cc:1918] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:48.428411 3839 log.cc:1196] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/a10227ac92d44f13b51095307ad925cc
I20260809 02:20:48.428694 3839 ts_tablet_manager.cc:1939] T a10227ac92d44f13b51095307ad925cc P a63c18467b0d4c08908d0b92cd8899d7: Deleting consensus metadata
I20260809 02:20:48.429412 2953 catalog_manager.cc:4841] TS a63c18467b0d4c08908d0b92cd8899d7 (127.1.81.194:39861): tablet a10227ac92d44f13b51095307ad925cc (table test-table [id=aa484a8070a547e68ce5ae3a46ecc375]) successfully deleted
I20260809 02:20:48.429730 3842 ts_tablet_manager.cc:1918] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:48.429803 3842 log.cc:1196] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/a10227ac92d44f13b51095307ad925cc
I20260809 02:20:48.430053 3842 ts_tablet_manager.cc:1939] T a10227ac92d44f13b51095307ad925cc P 06f1ddf95f3f461a97fc69a2e33170ca: Deleting consensus metadata
I20260809 02:20:48.430764 2949 catalog_manager.cc:4841] TS 06f1ddf95f3f461a97fc69a2e33170ca (127.1.81.193:42857): tablet a10227ac92d44f13b51095307ad925cc (table test-table [id=aa484a8070a547e68ce5ae3a46ecc375]) successfully deleted
I20260809 02:20:48.431021 3845 ts_tablet_manager.cc:1905] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 02:20:48 dist-test-slave-jlzn krb5kdc[2905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242047, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:20:48.433619 3845 ts_tablet_manager.cc:1918] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:48.433689 3845 log.cc:1196] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/a10227ac92d44f13b51095307ad925cc
I20260809 02:20:48.433925 3845 ts_tablet_manager.cc:1939] T a10227ac92d44f13b51095307ad925cc P f4bee5dbb757419eb9a53b53b9e8d486: Deleting consensus metadata
I20260809 02:20:48.434530 2949 catalog_manager.cc:4841] TS f4bee5dbb757419eb9a53b53b9e8d486 (127.1.81.195:43283): tablet a10227ac92d44f13b51095307ad925cc (table test-table [id=aa484a8070a547e68ce5ae3a46ecc375]) successfully deleted
I20260809 02:20:48.437666 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.425050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55900 (local address 127.1.81.193:42857)
0809 02:20:48.425177 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:48.425182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:48.425738 (+ 556us) server_negotiation.cc:407] Connection header received
0809 02:20:48.426027 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:48.426031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:48.426103 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:48.426162 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:48.427277 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.428021 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.429400 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.429718 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.429819 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.434029 (+ 4210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:48.434042 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:48.434057 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:48.434085 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:48.436001 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:48.436395 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:48.436401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:48.436403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:48.436509 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:48.436735 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:48.436737 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:48.436739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:48.437034 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:48.437272 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:48.437365 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 02:20:48.437487 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:20:48.438045 3266 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55900
I20260809 02:20:48.446743 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:48.439637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55478 (local address 127.1.81.254:45623)
0809 02:20:48.439763 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:48.439767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:48.439830 (+ 63us) server_negotiation.cc:407] Connection header received
0809 02:20:48.439959 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:48.439962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:48.440008 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:48.440084 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:48.440613 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.441421 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.442115 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:48.442484 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:48.442585 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:48.443772 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:48.443776 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:48.443779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:48.443828 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:48.445347 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:48.445711 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:48.445714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:48.445716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:48.445803 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:48.446003 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:48.446006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:48.446008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:48.446216 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:48.446342 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:48.446472 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 02:20:48.446593 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 02:20:48.447074 2973 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55478
I20260809 02:20:48.448318 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 3089
I20260809 02:20:48.462967 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 3299
I20260809 02:20:48.474278 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 3507
I20260809 02:20:48.490136 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2925
2026-08-09T02:20:48Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3231 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:48 dist-test-slave-jlzn krb5kdc[3855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:48 dist-test-slave-jlzn krb5kdc[3855](info): set up 2 sockets
Aug 09 02:20:48 dist-test-slave-jlzn krb5kdc[3855](info): commencing operation
krb5kdc: starting...
W20260809 02:20:49.615408 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:20:49 dist-test-slave-jlzn krb5kdc[3855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:20:49.728266 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:42505
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:49.834767 3874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:49.834986 3874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:49.835024 3874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:49.838851 3874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:49.838896 3874 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:20:49.838913 3874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:49.838943 3874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:49.838971 3874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:49.838995 3874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:49.843952 3874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:42505
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:42505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:49.844807 3874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:49.845702 3874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:49.853528 3881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:49.853664 3874 server_base.cc:1034] running on GCE node
W20260809 02:20:49.853513 3882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:49.853513 3885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:49.854362 3874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:49.855338 3874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:49.856495 3874 hybrid_clock.cc:648] HybridClock initialized: now 1786242049856477 us; error 28 us; skew 500 ppm
Aug 09 02:20:49 dist-test-slave-jlzn krb5kdc[3855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242049, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:49.859046 3874 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:20:49.859849 3874 webserver.cc:460] Webserver started at http://127.1.81.254:37269/ using document root <none> and password file <none>
I20260809 02:20:49.860333 3874 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:49.860390 3874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:49.860579 3874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:49.862416 3874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "e11d16cc36894d78aec9cf036ebbc70d"
format_stamp: "Formatted at 2026-08-09 02:20:49 on dist-test-slave-jlzn"
server_key: "37e2a6cd022f7e488b5b489ddd634251"
server_key_iv: "6a3078904f3491706541cfff98265c1e"
server_key_version: "encryptionkey@0"
I20260809 02:20:49.862977 3874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "e11d16cc36894d78aec9cf036ebbc70d"
format_stamp: "Formatted at 2026-08-09 02:20:49 on dist-test-slave-jlzn"
server_key: "37e2a6cd022f7e488b5b489ddd634251"
server_key_iv: "6a3078904f3491706541cfff98265c1e"
server_key_version: "encryptionkey@0"
I20260809 02:20:49.867508 3874 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 02:20:49.870368 3895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:49.874677 3874 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260809 02:20:49.874792 3874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "e11d16cc36894d78aec9cf036ebbc70d"
format_stamp: "Formatted at 2026-08-09 02:20:49 on dist-test-slave-jlzn"
server_key: "37e2a6cd022f7e488b5b489ddd634251"
server_key_iv: "6a3078904f3491706541cfff98265c1e"
server_key_version: "encryptionkey@0"
I20260809 02:20:49.874897 3874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:49.891067 3874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:49.894809 3874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:49.894966 3874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:49.902031 3874 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:42505
I20260809 02:20:49.902037 3988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:42505 every 8 connection(s)
I20260809 02:20:49.902906 3874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:49.904764 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 3874
I20260809 02:20:49.904866 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:20:49.905098 1351 external_mini_cluster.cc:1428] Setting key 1dc88ce728055462a17162b7f749687b
I20260809 02:20:49.905593 3989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:49.912215 3989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: Bootstrap starting.
Aug 09 02:20:49 dist-test-slave-jlzn krb5kdc[3855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:49.914316 3989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:49.915578 3989 log.cc:824] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:49.917668 3989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: No bootstrap required, opened a new log
I20260809 02:20:49.918884 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:49.906390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49354 (local address 127.1.81.254:42505)
0809 02:20:49.906784 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:49.906802 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:49.906842 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:20:49.907582 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:49.907604 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:49.908015 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:49.908367 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:49.908993 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:49.910420 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:49.911209 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:49.911926 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:49.912071 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:49.914269 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:49.914275 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:49.914290 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:49.914322 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:49.916092 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:49.916534 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:49.916539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:49.916544 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:49.916678 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:49.916901 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:49.916904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:49.916906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:49.917394 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:49.917566 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:49.917763 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 02:20:49.918038 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":104,"threads_started":1}
I20260809 02:20:49.921054 3989 raft_consensus.cc:348] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11d16cc36894d78aec9cf036ebbc70d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42505 } }
I20260809 02:20:49.921247 3989 raft_consensus.cc:374] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:49.921288 3989 raft_consensus.cc:729] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11d16cc36894d78aec9cf036ebbc70d, State: Initialized, Role: FOLLOWER
I20260809 02:20:49.921633 3989 consensus_queue.cc:260] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11d16cc36894d78aec9cf036ebbc70d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42505 } }
I20260809 02:20:49.921761 3989 raft_consensus.cc:388] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:49.921804 3989 raft_consensus.cc:482] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:49.921873 3989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:49.922580 3989 raft_consensus.cc:504] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11d16cc36894d78aec9cf036ebbc70d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42505 } }
I20260809 02:20:49.922863 3989 leader_election.cc:302] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e11d16cc36894d78aec9cf036ebbc70d; no voters:
I20260809 02:20:49.923080 3989 leader_election.cc:288] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:49.923190 3995 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:49.923389 3995 raft_consensus.cc:686] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [term 1 LEADER]: Becoming Leader. State: Replica: e11d16cc36894d78aec9cf036ebbc70d, State: Running, Role: LEADER
I20260809 02:20:49.923673 3995 consensus_queue.cc:237] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11d16cc36894d78aec9cf036ebbc70d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42505 } }
I20260809 02:20:49.924126 3989 sys_catalog.cc:564] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:49.925215 3996 sys_catalog.cc:455] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e11d16cc36894d78aec9cf036ebbc70d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11d16cc36894d78aec9cf036ebbc70d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42505 } } }
I20260809 02:20:49.925899 3996 sys_catalog.cc:458] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:49.925787 3997 sys_catalog.cc:455] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e11d16cc36894d78aec9cf036ebbc70d. Latest consensus state: current_term: 1 leader_uuid: "e11d16cc36894d78aec9cf036ebbc70d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11d16cc36894d78aec9cf036ebbc70d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42505 } } }
I20260809 02:20:49.926643 3997 sys_catalog.cc:458] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d [sys.catalog]: This master's current role is: LEADER
W20260809 02:20:49.928464 4020 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:20:49.928529 4020 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:20:49.928635 4021 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:49.929576 4021 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:49.934404 4021 catalog_manager.cc:1347] Generated new cluster ID: d5391d73509c47dc91e8967b3c9d12ad
I20260809 02:20:49.934466 4021 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:49.967607 4021 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:49.968459 4021 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:49.977310 4021 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: Generated new TSK 0
I20260809 02:20:49.977885 4021 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:20:50.006403 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42505
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:50.112691 4033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:50.112912 4033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:50.112975 4033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:50.116848 4033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:50.116899 4033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:50.116952 4033 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:20:50.116976 4033 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:20:50.117020 4033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:20:50.121946 4033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:50.122810 4033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:50.123684 4033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:50.132676 4040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:50.132683 4042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:50.132835 4033 server_base.cc:1034] running on GCE node
W20260809 02:20:50.132694 4039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:50.133329 4033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:50.133879 4033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:50.135027 4033 hybrid_clock.cc:648] HybridClock initialized: now 1786242050135007 us; error 35 us; skew 500 ppm
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242050, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:50.137609 4033 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:20:50.138393 4033 webserver.cc:460] Webserver started at http://127.1.81.193:36319/ using document root <none> and password file <none>
I20260809 02:20:50.138888 4033 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:50.138952 4033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:50.139132 4033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:50.141002 4033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "725d4abdc86c4121a4757a878b8da15e"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "c903c223b75dfe9ab3f36f8ab0fbd912"
server_key_iv: "eb34313e74fcc567ead03c0f8cdbb5e0"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.141512 4033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "725d4abdc86c4121a4757a878b8da15e"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "c903c223b75dfe9ab3f36f8ab0fbd912"
server_key_iv: "eb34313e74fcc567ead03c0f8cdbb5e0"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.144887 4033 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:50.147078 4053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:50.148178 4033 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:50.148283 4033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "725d4abdc86c4121a4757a878b8da15e"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "c903c223b75dfe9ab3f36f8ab0fbd912"
server_key_iv: "eb34313e74fcc567ead03c0f8cdbb5e0"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.148367 4033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:50.157452 4033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:50.159783 4033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:50.159982 4033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:50.161265 4033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:50.161314 4033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:50.161362 4033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:50.161393 4033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242050, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:50.171244 4033 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:34413
I20260809 02:20:50.171442 4232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:34413 every 8 connection(s)
I20260809 02:20:50.172240 4033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:50.174670 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.161875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:35745 (local address 127.1.81.254:42505)
0809 02:20:50.161993 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.161997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.163741 (+ 1744us) server_negotiation.cc:407] Connection header received
0809 02:20:50.164874 (+ 1133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.164878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.164937 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.165015 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:50.166082 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.166658 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.167760 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.168166 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.168288 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.171564 (+ 3276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:50.171569 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:50.171571 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:50.171599 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:50.173117 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.173535 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.173538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.173539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.173606 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.173852 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.173854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.173855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.174011 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:50.174077 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.174452 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.174549 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:20:50.175374 4065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.163036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42505 (local address 127.1.81.193:35745)
0809 02:20:50.163581 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.163633 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.164647 (+ 1014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.165174 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.165179 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.165507 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:50.165928 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.165941 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.166777 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.166781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.167626 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.167636 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.168335 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.168340 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.168536 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.169637 (+ 1101us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:50.169661 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:50.171392 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:50.173215 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.173219 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.173228 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.173460 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.173671 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.173673 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.173674 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.173790 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.174078 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:50.174082 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:50.174281 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.174419 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.174635 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":168,"threads_started":1}
I20260809 02:20:50.176443 4233 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42505
I20260809 02:20:50.176632 4233 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:50.177079 4233 heartbeater.cc:511] Master 127.1.81.254:42505 requested a full tablet report, sending...
I20260809 02:20:50.178627 3922 ts_manager.cc:194] Registered new tserver with Master: 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413)
I20260809 02:20:50.179785 3922 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:35745
I20260809 02:20:50.181756 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 4033
I20260809 02:20:50.181876 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:50.182189 1351 external_mini_cluster.cc:1428] Setting key e329e8099d77d4b099d945a09ad1f338
I20260809 02:20:50.185103 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.178527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:57677 (local address 127.1.81.254:42505)
0809 02:20:50.178639 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.178643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.178840 (+ 197us) server_negotiation.cc:407] Connection header received
0809 02:20:50.178930 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.178934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.178975 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.179034 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:50.179433 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.180097 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.180988 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.181217 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.181302 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.182339 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:50.182343 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:50.182345 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:50.182366 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:50.183681 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.184127 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.184129 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.184130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.184207 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.184461 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.184463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.184464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.184601 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:50.184670 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.184912 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.185000 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:20:50.185168 4242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.178432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42505 (local address 127.1.81.193:57677)
0809 02:20:50.178759 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.178773 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.178863 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.179060 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.179063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.179235 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:50.179327 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.179332 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.180212 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.180216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.180883 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.180894 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.181315 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.181319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.181410 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.181819 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:50.181834 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:50.182217 (+ 383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:50.183787 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.183791 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.183793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.184042 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.184289 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.184292 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.184293 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.184383 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.184682 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:50.184684 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:50.184775 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.184867 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.184990 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:20:50.207356 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42505
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:50.314723 4245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:50.314939 4245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:50.314982 4245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:50.318856 4245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:50.318907 4245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:50.318943 4245 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:20:50.318961 4245 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:20:50.318990 4245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:20:50.323941 4245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:50.324882 4245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:50.325759 4245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:50.334748 4254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:50.334753 4258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:50.334905 4245 server_base.cc:1034] running on GCE node
W20260809 02:20:50.335083 4256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:50.335449 4245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:50.336033 4245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:50.337188 4245 hybrid_clock.cc:648] HybridClock initialized: now 1786242050337168 us; error 29 us; skew 500 ppm
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242050, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:50.339682 4245 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:20:50.340478 4245 webserver.cc:460] Webserver started at http://127.1.81.194:46715/ using document root <none> and password file <none>
I20260809 02:20:50.340953 4245 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:50.341010 4245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:50.341164 4245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:50.342967 4245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "c706aedf43514dddbb2650e4088fdabf"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "3f99807f28e1cfaf4c025c9bbec07bf4"
server_key_iv: "48987170f58c2ba9bfc6373be3eeb2ee"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.343448 4245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "c706aedf43514dddbb2650e4088fdabf"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "3f99807f28e1cfaf4c025c9bbec07bf4"
server_key_iv: "48987170f58c2ba9bfc6373be3eeb2ee"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.346755 4245 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 02:20:50.348968 4268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:50.350045 4245 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:50.350140 4245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "c706aedf43514dddbb2650e4088fdabf"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "3f99807f28e1cfaf4c025c9bbec07bf4"
server_key_iv: "48987170f58c2ba9bfc6373be3eeb2ee"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.350219 4245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:50.361750 4245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:50.364248 4245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:50.364399 4245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:50.365706 4245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:50.365758 4245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:50.365808 4245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:50.365833 4245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242050, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:50.376032 4245 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:40781
I20260809 02:20:50.376160 4442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:40781 every 8 connection(s)
I20260809 02:20:50.376989 4245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:20:50.378407 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.366283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:59223 (local address 127.1.81.254:42505)
0809 02:20:50.366431 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.366437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.367630 (+ 1193us) server_negotiation.cc:407] Connection header received
0809 02:20:50.368702 (+ 1072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.368706 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.368763 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.368835 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:50.369979 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.370579 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.371681 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.371984 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.372076 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.374745 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:50.374749 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:50.374753 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:50.374785 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:50.376302 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.376872 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.376875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.376876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.376951 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.377304 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.377308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.377310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.377529 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:50.377623 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.378183 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.378286 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:20:50.379081 4280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.367046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42505 (local address 127.1.81.194:59223)
0809 02:20:50.367473 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.367519 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.368502 (+ 983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.369007 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.369016 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.369316 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:50.369829 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.369850 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.370714 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.370717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.371562 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.371572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.372147 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.372152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.372312 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.372838 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:50.372857 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:50.374566 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:50.376409 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.376415 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.376427 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.376775 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.377038 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.377041 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.377043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.377212 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.377705 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:50.377711 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:50.377961 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.378105 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.378327 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":107,"threads_started":1}
I20260809 02:20:50.380200 4444 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42505
I20260809 02:20:50.380342 4444 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:50.380851 4444 heartbeater.cc:511] Master 127.1.81.254:42505 requested a full tablet report, sending...
I20260809 02:20:50.381914 3923 ts_manager.cc:194] Registered new tserver with Master: c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781)
I20260809 02:20:50.382616 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 4245
I20260809 02:20:50.382659 3923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:59223
I20260809 02:20:50.382743 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:50.383044 1351 external_mini_cluster.cc:1428] Setting key 15b3aa5502cbe585662876b194ea51de
I20260809 02:20:50.390517 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.382383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:53077 (local address 127.1.81.254:42505)
0809 02:20:50.382491 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.382495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.383117 (+ 622us) server_negotiation.cc:407] Connection header received
0809 02:20:50.384522 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.384525 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.384561 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.384620 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:50.385051 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.385518 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.386507 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.386818 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.386916 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.387772 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:50.387774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:50.387776 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:50.387799 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:50.388953 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.389433 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.389437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.389438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.389526 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.389798 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.389800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.389801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.389985 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:50.390055 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.390324 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.390410 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:20:50.390601 4451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.382283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42505 (local address 127.1.81.194:53077)
0809 02:20:50.383036 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.383050 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.384423 (+ 1373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.384661 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.384664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.384854 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:50.384961 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.384968 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.385646 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.385649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.386400 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.386410 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.386911 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.386914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.386976 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.387370 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:50.387380 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:50.387652 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:50.389067 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.389070 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.389072 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.389326 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.389609 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.389612 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.389614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.389718 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.390073 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:50.390076 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:50.390176 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.390289 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.390419 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:20:50.408324 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42505
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:50.514763 4456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:50.514979 4456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:50.515041 4456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:50.518908 4456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:50.518957 4456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:50.519011 4456 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:20:50.519039 4456 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:20:50.519084 4456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:20:50.523998 4456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:50.524906 4456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:50.525841 4456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:50.534495 4466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:50.534610 4462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:50.534725 4463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:50.534727 4456 server_base.cc:1034] running on GCE node
I20260809 02:20:50.535193 4456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:50.535758 4456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:50.536928 4456 hybrid_clock.cc:648] HybridClock initialized: now 1786242050536913 us; error 27 us; skew 500 ppm
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242050, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:50.539422 4456 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:20:50.540211 4456 webserver.cc:460] Webserver started at http://127.1.81.195:40999/ using document root <none> and password file <none>
I20260809 02:20:50.540697 4456 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:50.540763 4456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:50.540949 4456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:50.543004 4456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "2491d9d8b1f24cb1a494f8d844222799"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "cbc62a1a8be00ae394d6fee0f88c3358"
server_key_iv: "4f641338d9272bc7a1fdc77cf092306d"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.543524 4456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "2491d9d8b1f24cb1a494f8d844222799"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "cbc62a1a8be00ae394d6fee0f88c3358"
server_key_iv: "4f641338d9272bc7a1fdc77cf092306d"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.546838 4456 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:20:50.549011 4474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:50.550069 4456 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:50.550177 4456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "2491d9d8b1f24cb1a494f8d844222799"
format_stamp: "Formatted at 2026-08-09 02:20:50 on dist-test-slave-jlzn"
server_key: "cbc62a1a8be00ae394d6fee0f88c3358"
server_key_iv: "4f641338d9272bc7a1fdc77cf092306d"
server_key_version: "encryptionkey@0"
I20260809 02:20:50.550264 4456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:50.590230 4456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:50.593334 4456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:50.593518 4456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:50.594921 4456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:50.594972 4456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:50.595024 4456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:50.595054 4456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242050, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:50.605279 4456 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:41837
I20260809 02:20:50.605355 4643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:41837 every 8 connection(s)
I20260809 02:20:50.606300 4456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:20:50.607947 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.595662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:58033 (local address 127.1.81.254:42505)
0809 02:20:50.595841 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.595847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.596598 (+ 751us) server_negotiation.cc:407] Connection header received
0809 02:20:50.597514 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.597518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.597575 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.597661 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:50.599180 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.599969 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.601198 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.601432 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.601517 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.604475 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:50.604479 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:50.604481 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:50.604506 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:50.605999 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.606482 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.606486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.606488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.606567 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.606939 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.606942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.606944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.607153 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:50.607254 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.607685 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.607779 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:20:50.608632 4491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.596018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42505 (local address 127.1.81.195:58033)
0809 02:20:50.596443 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.596492 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.597319 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.597910 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.597919 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.598377 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:50.599013 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.599047 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.600090 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.600094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.601076 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.601087 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.601597 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.601602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.601754 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.602234 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:50.602250 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:50.604310 (+ 2060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:50.606120 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.606124 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.606134 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.606387 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.606650 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.606653 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.606656 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.606825 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.607263 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:50.607268 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:50.607474 (+ 206us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.607638 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.607908 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":97,"threads_started":1}
I20260809 02:20:50.609673 4646 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42505
I20260809 02:20:50.609805 4646 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:50.610262 4646 heartbeater.cc:511] Master 127.1.81.254:42505 requested a full tablet report, sending...
I20260809 02:20:50.611238 3922 ts_manager.cc:194] Registered new tserver with Master: 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837)
I20260809 02:20:50.611954 3922 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:58033
I20260809 02:20:50.613576 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 4456
I20260809 02:20:50.613694 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:50.613974 1351 external_mini_cluster.cc:1428] Setting key e1ec0030a1ca20c9befcd4cad2a61972
I20260809 02:20:50.616042 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:20:50.618675 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.611629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42505 (local address 127.1.81.195:60397)
0809 02:20:50.611954 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.611965 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.612049 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.612286 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.612289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.612483 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:50.612590 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.612596 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.613585 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.613589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.614348 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.614358 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.614822 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.614825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.614899 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.615346 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:50.615359 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:50.615763 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:50.617366 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.617368 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.617370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.617570 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.617813 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.617815 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.617817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.617882 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.618223 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:50.618225 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:50.618306 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.618393 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.618520 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":103,"threads_started":1}
I20260809 02:20:50.618709 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.611725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:60397 (local address 127.1.81.254:42505)
0809 02:20:50.611853 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.611856 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.612028 (+ 172us) server_negotiation.cc:407] Connection header received
0809 02:20:50.612130 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.612133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.612176 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.612248 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:50.612699 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.613445 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.614457 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.614718 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.614807 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.615938 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:50.615941 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:50.615943 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:50.615965 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:50.617264 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.617653 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.617656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.617657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.617741 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.617947 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.617949 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.617951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.618133 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:50.618230 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.618456 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.618561 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:50.641947 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.634933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49370 (local address 127.1.81.254:42505)
0809 02:20:50.635047 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.635051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.635063 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:20:50.635089 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.635091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.635120 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.635186 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:50.635874 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.636346 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.637146 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.637348 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.637429 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.639435 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:50.639438 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:50.639440 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:50.639461 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:50.640520 (+ 1059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.640894 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.640897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.640898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.640969 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.641205 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.641208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.641210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.641363 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:50.641478 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.641702 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.641809 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:20:50.644351 3922 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:20:50.647166 3922 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:50.660778 4671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.655200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:41837 (local address 127.0.0.1:57710)
0809 02:20:50.656021 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.656070 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.656191 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.656657 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.656663 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.656687 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:50.656809 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.656816 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.657897 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.657900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.659271 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.659283 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.660219 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.660223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.660329 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.660370 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.660472 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.660609 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":49,"thread_start_us":73,"threads_started":1}
I20260809 02:20:50.660790 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.655258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57710 (local address 127.1.81.195:41837)
0809 02:20:50.656192 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.656203 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.656228 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:20:50.656326 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.656331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.656507 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.656676 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:50.656918 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.657778 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.659383 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.660108 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.660205 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.660372 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.660500 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.660640 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":846,"thread_start_us":112,"threads_started":1}
I20260809 02:20:50.661854 4674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.655349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40781 (local address 127.0.0.1:42772)
0809 02:20:50.656429 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.656441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.656613 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.657352 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.657355 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.657373 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:50.657456 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.657462 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.658565 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.658569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.659642 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.659653 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.661429 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.661432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.661522 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.661546 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.661624 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.661692 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"mutex_wait_us":31,"thread_start_us":82,"threads_started":1}
I20260809 02:20:50.661916 4672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.655526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42772 (local address 127.1.81.194:40781)
0809 02:20:50.656004 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.656021 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.656522 (+ 501us) server_negotiation.cc:407] Connection header received
0809 02:20:50.656782 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.656787 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.656966 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.657171 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:50.657574 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.658459 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.659765 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.660609 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.660743 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.661363 (+ 620us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.661677 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.661779 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":143,"threads_started":1}
I20260809 02:20:50.662583 4667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.656223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34413 (local address 127.0.0.1:58000)
0809 02:20:50.657347 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.657359 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.657443 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.657851 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.657854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.657874 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:50.658030 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.658036 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.659586 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.659589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.660753 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.660763 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.662203 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.662206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.662307 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.662330 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.662397 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.662463 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1062,"mutex_wait_us":25,"thread_start_us":82,"threads_started":1}
I20260809 02:20:50.663003 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.656573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58000 (local address 127.1.81.193:34413)
0809 02:20:50.657200 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.657217 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.657452 (+ 235us) server_negotiation.cc:407] Connection header received
0809 02:20:50.657535 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.657540 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.657705 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.657856 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:50.658155 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.659492 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.661012 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.661849 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.661935 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.662101 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.662762 (+ 661us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.662863 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":97,"threads_started":1}
I20260809 02:20:50.663770 4553 tablet_service.cc:1467] Processing CreateTablet for tablet b8e78c261e0e41cf9de4a86a07f2186a (DEFAULT_TABLE table=test-table [id=34c6f4da92204f83af09ab39a8685544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:50.665114 4553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e78c261e0e41cf9de4a86a07f2186a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.664871 4344 tablet_service.cc:1467] Processing CreateTablet for tablet b8e78c261e0e41cf9de4a86a07f2186a (DEFAULT_TABLE table=test-table [id=34c6f4da92204f83af09ab39a8685544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:50.665843 4344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e78c261e0e41cf9de4a86a07f2186a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.665946 4123 tablet_service.cc:1467] Processing CreateTablet for tablet b8e78c261e0e41cf9de4a86a07f2186a (DEFAULT_TABLE table=test-table [id=34c6f4da92204f83af09ab39a8685544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:50.666668 4123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8e78c261e0e41cf9de4a86a07f2186a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.673044 4676 tablet_bootstrap.cc:492] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Bootstrap starting.
I20260809 02:20:50.673842 4677 tablet_bootstrap.cc:492] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Bootstrap starting.
I20260809 02:20:50.673842 4678 tablet_bootstrap.cc:492] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Bootstrap starting.
I20260809 02:20:50.675097 4676 tablet_bootstrap.cc:654] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.675886 4676 log.cc:824] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:50.676012 4677 tablet_bootstrap.cc:654] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.676012 4678 tablet_bootstrap.cc:654] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.676864 4678 log.cc:824] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:50.676909 4677 log.cc:824] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:50.677665 4676 tablet_bootstrap.cc:492] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: No bootstrap required, opened a new log
I20260809 02:20:50.677868 4676 ts_tablet_manager.cc:1397] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:20:50.678740 4678 tablet_bootstrap.cc:492] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: No bootstrap required, opened a new log
I20260809 02:20:50.678934 4678 ts_tablet_manager.cc:1397] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:20:50.679320 4677 tablet_bootstrap.cc:492] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: No bootstrap required, opened a new log
I20260809 02:20:50.679637 4677 ts_tablet_manager.cc:1397] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:20:50.681157 4676 raft_consensus.cc:348] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.681362 4676 raft_consensus.cc:374] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:50.681424 4676 raft_consensus.cc:729] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725d4abdc86c4121a4757a878b8da15e, State: Initialized, Role: FOLLOWER
I20260809 02:20:50.681813 4676 consensus_queue.cc:260] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.682447 4233 heartbeater.cc:503] Master 127.1.81.254:42505 was elected leader, sending a full tablet report...
I20260809 02:20:50.682700 4676 ts_tablet_manager.cc:1428] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:20:50.682837 4678 raft_consensus.cc:348] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.683085 4678 raft_consensus.cc:374] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:50.683141 4678 raft_consensus.cc:729] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c706aedf43514dddbb2650e4088fdabf, State: Initialized, Role: FOLLOWER
I20260809 02:20:50.683542 4678 consensus_queue.cc:260] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.684185 4444 heartbeater.cc:503] Master 127.1.81.254:42505 was elected leader, sending a full tablet report...
I20260809 02:20:50.684124 4677 raft_consensus.cc:348] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.684345 4677 raft_consensus.cc:374] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:50.684401 4677 raft_consensus.cc:729] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2491d9d8b1f24cb1a494f8d844222799, State: Initialized, Role: FOLLOWER
I20260809 02:20:50.684758 4677 consensus_queue.cc:260] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.685469 4678 ts_tablet_manager.cc:1428] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260809 02:20:50.685662 4677 ts_tablet_manager.cc:1428] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:20:50.686064 4646 heartbeater.cc:503] Master 127.1.81.254:42505 was elected leader, sending a full tablet report...
I20260809 02:20:50.756923 4683 raft_consensus.cc:482] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:50.757099 4683 raft_consensus.cc:504] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.758066 4683 leader_election.cc:288] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837), 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413)
I20260809 02:20:50.761917 4280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.758258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34413 (local address 127.1.81.194:47555)
0809 02:20:50.758405 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.758419 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.758510 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.758808 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.758811 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.758825 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:50.758955 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.758962 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.759725 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.759728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.760869 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.760880 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.761589 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.761592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.761677 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.761697 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.761753 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.761809 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 02:20:50.761979 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.758338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:47555 (local address 127.1.81.193:34413)
0809 02:20:50.758440 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.758444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.758459 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:20:50.758644 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.758647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.758706 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.758786 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:50.759068 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.759620 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.760994 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.761476 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.761589 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.761642 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.761786 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.761854 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:20:50.762377 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.758471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:51087 (local address 127.1.81.195:41837)
0809 02:20:50.758577 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.758582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.758684 (+ 102us) server_negotiation.cc:407] Connection header received
0809 02:20:50.758777 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.758780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.758823 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.758891 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:50.759509 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.760088 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.761292 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.761831 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.761943 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.761987 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.762211 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.762285 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 02:20:50.762387 4685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.758258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:41837 (local address 127.1.81.194:51087)
0809 02:20:50.758609 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.758621 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.758697 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.758907 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.758910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.758922 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:50.759397 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.759405 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.760194 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.760198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.761186 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.761194 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.761967 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.761971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.762076 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.762102 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.762179 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.762243 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":29,"thread_start_us":93,"threads_started":1}
I20260809 02:20:50.762630 4151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8e78c261e0e41cf9de4a86a07f2186a" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725d4abdc86c4121a4757a878b8da15e" is_pre_election: true
I20260809 02:20:50.762931 4151 raft_consensus.cc:2454] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 0.
I20260809 02:20:50.763087 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8e78c261e0e41cf9de4a86a07f2186a" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2491d9d8b1f24cb1a494f8d844222799" is_pre_election: true
I20260809 02:20:50.763327 4581 raft_consensus.cc:2454] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 0.
I20260809 02:20:50.763404 4272 leader_election.cc:302] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725d4abdc86c4121a4757a878b8da15e, c706aedf43514dddbb2650e4088fdabf; no voters:
I20260809 02:20:50.763650 4683 raft_consensus.cc:2781] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:50.763734 4683 raft_consensus.cc:482] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:50.763767 4683 raft_consensus.cc:3037] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:50.764861 4683 raft_consensus.cc:504] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.765177 4683 leader_election.cc:288] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 election: Requested vote from peers 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837), 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413)
I20260809 02:20:50.765494 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8e78c261e0e41cf9de4a86a07f2186a" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2491d9d8b1f24cb1a494f8d844222799"
I20260809 02:20:50.765527 4151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8e78c261e0e41cf9de4a86a07f2186a" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725d4abdc86c4121a4757a878b8da15e"
I20260809 02:20:50.765610 4581 raft_consensus.cc:3037] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:50.765622 4151 raft_consensus.cc:3037] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:50.766570 4151 raft_consensus.cc:2454] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 1.
I20260809 02:20:50.766844 4272 leader_election.cc:302] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725d4abdc86c4121a4757a878b8da15e, c706aedf43514dddbb2650e4088fdabf; no voters:
I20260809 02:20:50.766938 4581 raft_consensus.cc:2454] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 1.
I20260809 02:20:50.767017 4683 raft_consensus.cc:2781] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:50.767220 4683 raft_consensus.cc:686] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 1 LEADER]: Becoming Leader. State: Replica: c706aedf43514dddbb2650e4088fdabf, State: Running, Role: LEADER
I20260809 02:20:50.767520 4683 consensus_queue.cc:237] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } }
I20260809 02:20:50.770538 3922 catalog_manager.cc:5495] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf reported cstate change: term changed from 0 to 1, leader changed from <none> to c706aedf43514dddbb2650e4088fdabf (127.1.81.194). New cstate: current_term: 1 leader_uuid: "c706aedf43514dddbb2650e4088fdabf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:20:50 dist-test-slave-jlzn krb5kdc[3855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242049, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:50.804608 3992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.797266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49374 (local address 127.1.81.254:42505)
0809 02:20:50.797386 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.797391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.797528 (+ 137us) server_negotiation.cc:407] Connection header received
0809 02:20:50.797659 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.797662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.797701 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.797757 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:50.798376 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.798882 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.799619 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.799904 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.799988 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.801956 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:50.801959 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:50.801962 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:50.801985 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:50.803053 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.803464 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.803468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.803470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.803544 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:50.803775 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:50.803778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:50.803780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:50.803970 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:50.804054 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.804331 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.804476 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":43}
I20260809 02:20:50.804616 4698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.797196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42505 (local address 127.0.0.1:49374)
0809 02:20:50.797455 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.797466 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.797562 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.797787 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.797789 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.798177 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:50.798268 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.798274 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.798976 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.798979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.799519 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.799526 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.799994 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.799998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.800076 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.800545 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:50.800556 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:50.801835 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:50.803153 (+ 1318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.803162 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.803168 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.803377 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.803619 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:50.803622 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:50.803624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:50.803698 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:50.804064 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:50.804070 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:50.804179 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.804272 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.804423 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":99,"threads_started":1}
I20260809 02:20:50.807934 3922 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:49374:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:20:50.808605 3922 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:50.813045 4123 tablet_service.cc:1467] Processing CreateTablet for tablet d3ce6826bf3f45ed8b6bd9bb2b266873 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1ab97000c054876b9716363d97b5eef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:20:50.813153 4344 tablet_service.cc:1467] Processing CreateTablet for tablet d3ce6826bf3f45ed8b6bd9bb2b266873 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1ab97000c054876b9716363d97b5eef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:20:50.813733 4344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ce6826bf3f45ed8b6bd9bb2b266873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.813733 4123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ce6826bf3f45ed8b6bd9bb2b266873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.816677 4676 tablet_bootstrap.cc:492] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: Bootstrap starting.
I20260809 02:20:50.816676 4678 tablet_bootstrap.cc:492] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: Bootstrap starting.
I20260809 02:20:50.817124 4553 tablet_service.cc:1467] Processing CreateTablet for tablet d3ce6826bf3f45ed8b6bd9bb2b266873 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1ab97000c054876b9716363d97b5eef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:20:50.817657 4676 tablet_bootstrap.cc:654] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.817651 4678 tablet_bootstrap.cc:654] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.817677 4553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ce6826bf3f45ed8b6bd9bb2b266873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.818909 4676 tablet_bootstrap.cc:492] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: No bootstrap required, opened a new log
I20260809 02:20:50.819006 4676 ts_tablet_manager.cc:1397] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:50.819152 4678 tablet_bootstrap.cc:492] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: No bootstrap required, opened a new log
I20260809 02:20:50.819239 4678 ts_tablet_manager.cc:1397] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 02:20:50.819459 4676 raft_consensus.cc:348] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.819573 4676 raft_consensus.cc:374] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:50.819614 4676 raft_consensus.cc:729] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725d4abdc86c4121a4757a878b8da15e, State: Initialized, Role: FOLLOWER
I20260809 02:20:50.819625 4678 raft_consensus.cc:348] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.819732 4678 raft_consensus.cc:374] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:50.819764 4678 raft_consensus.cc:729] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c706aedf43514dddbb2650e4088fdabf, State: Initialized, Role: FOLLOWER
I20260809 02:20:50.819743 4676 consensus_queue.cc:260] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.819907 4678 consensus_queue.cc:260] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.820093 4676 ts_tablet_manager.cc:1428] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:50.820159 4678 ts_tablet_manager.cc:1428] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:50.820353 4682 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.820482 4682 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:50.820552 4677 tablet_bootstrap.cc:492] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: Bootstrap starting.
I20260809 02:20:50.821004 4683 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.821141 4683 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:50.821527 4677 tablet_bootstrap.cc:654] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.822817 4677 tablet_bootstrap.cc:492] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: No bootstrap required, opened a new log
I20260809 02:20:50.822916 4677 ts_tablet_manager.cc:1397] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:50.823364 4677 raft_consensus.cc:348] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.823475 4677 raft_consensus.cc:374] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:50.823514 4677 raft_consensus.cc:729] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2491d9d8b1f24cb1a494f8d844222799, State: Initialized, Role: FOLLOWER
I20260809 02:20:50.823668 4677 consensus_queue.cc:260] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.823927 4677 ts_tablet_manager.cc:1428] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:50.823911 4684 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.824051 4684 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:50.851078 4682 raft_consensus.cc:482] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:50.851194 4682 raft_consensus.cc:504] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.852317 4682 leader_election.cc:288] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781), 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837)
I20260809 02:20:50.856419 4672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.852581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:48027 (local address 127.1.81.194:40781)
0809 02:20:50.852724 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.852730 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.852852 (+ 122us) server_negotiation.cc:407] Connection header received
0809 02:20:50.853022 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.853025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.853065 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.853122 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:50.853401 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.854095 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.855346 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.855870 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.855959 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.855996 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.856233 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.856297 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:20:50.856436 4704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.852473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40781 (local address 127.1.81.193:48027)
0809 02:20:50.852752 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.852768 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.852886 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.853145 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.853148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.853165 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:50.853298 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.853306 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.854201 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.854204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.855227 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.855238 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.856015 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.856019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.856122 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.856149 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.856219 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.856289 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":68,"threads_started":1}
I20260809 02:20:50.856662 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.852591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:48417 (local address 127.1.81.195:41837)
0809 02:20:50.852814 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.852818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.852912 (+ 94us) server_negotiation.cc:407] Connection header received
0809 02:20:50.853071 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.853074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.853114 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.853207 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:50.853865 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.854526 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.855640 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.856122 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.856249 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.856293 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.856479 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.856551 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260809 02:20:50.856892 4706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.852543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:41837 (local address 127.1.81.193:48417)
0809 02:20:50.852827 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.852838 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.852926 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.853228 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.853231 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.853251 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:50.853753 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.853765 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.854626 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.854628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.855521 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.855532 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.856253 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.856257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.856354 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.856379 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.856455 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.856743 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":10,"thread_start_us":107,"threads_started":1}
W20260809 02:20:50.857187 4647 tablet.cc:2369] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:50.857154 4379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ce6826bf3f45ed8b6bd9bb2b266873" candidate_uuid: "725d4abdc86c4121a4757a878b8da15e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c706aedf43514dddbb2650e4088fdabf" is_pre_election: true
I20260809 02:20:50.857314 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ce6826bf3f45ed8b6bd9bb2b266873" candidate_uuid: "725d4abdc86c4121a4757a878b8da15e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2491d9d8b1f24cb1a494f8d844222799" is_pre_election: true
I20260809 02:20:50.857373 4379 raft_consensus.cc:2454] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725d4abdc86c4121a4757a878b8da15e in term 0.
I20260809 02:20:50.857434 4581 raft_consensus.cc:2454] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725d4abdc86c4121a4757a878b8da15e in term 0.
I20260809 02:20:50.857789 4059 leader_election.cc:302] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2491d9d8b1f24cb1a494f8d844222799, 725d4abdc86c4121a4757a878b8da15e; no voters:
I20260809 02:20:50.858063 4682 raft_consensus.cc:2781] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:50.858122 4682 raft_consensus.cc:482] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:50.858150 4682 raft_consensus.cc:3037] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:50.859032 4682 raft_consensus.cc:504] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.859361 4682 leader_election.cc:288] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [CANDIDATE]: Term 1 election: Requested vote from peers c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781), 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837)
I20260809 02:20:50.859648 4379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ce6826bf3f45ed8b6bd9bb2b266873" candidate_uuid: "725d4abdc86c4121a4757a878b8da15e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c706aedf43514dddbb2650e4088fdabf"
I20260809 02:20:50.859745 4379 raft_consensus.cc:3037] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:50.859704 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ce6826bf3f45ed8b6bd9bb2b266873" candidate_uuid: "725d4abdc86c4121a4757a878b8da15e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2491d9d8b1f24cb1a494f8d844222799"
I20260809 02:20:50.859833 4581 raft_consensus.cc:3037] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:50.860741 4581 raft_consensus.cc:2454] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725d4abdc86c4121a4757a878b8da15e in term 1.
I20260809 02:20:50.860808 4379 raft_consensus.cc:2454] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725d4abdc86c4121a4757a878b8da15e in term 1.
I20260809 02:20:50.861011 4059 leader_election.cc:302] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2491d9d8b1f24cb1a494f8d844222799, 725d4abdc86c4121a4757a878b8da15e; no voters:
I20260809 02:20:50.861167 4682 raft_consensus.cc:2781] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:50.861370 4682 raft_consensus.cc:686] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [term 1 LEADER]: Becoming Leader. State: Replica: 725d4abdc86c4121a4757a878b8da15e, State: Running, Role: LEADER
I20260809 02:20:50.861681 4682 consensus_queue.cc:237] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:50.863474 4708 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: TxnStatusTablet state changed. Reason: New leader 725d4abdc86c4121a4757a878b8da15e. Latest consensus state: current_term: 1 leader_uuid: "725d4abdc86c4121a4757a878b8da15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.863605 4708 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:20:50.863998 4710 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:20:50.864195 4710 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:20:50.867018 3922 catalog_manager.cc:5495] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e reported cstate change: term changed from 0 to 1, leader changed from <none> to 725d4abdc86c4121a4757a878b8da15e (127.1.81.193). New cstate: current_term: 1 leader_uuid: "725d4abdc86c4121a4757a878b8da15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } health_report { overall_health: UNKNOWN } } }
W20260809 02:20:50.878127 4445 tablet.cc:2369] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:50.884377 4698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.879683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34413 (local address 127.0.0.1:58004)
0809 02:20:50.879934 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.879946 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.880087 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.880427 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.880429 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.880434 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:20:50.880522 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.880527 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.882156 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.882159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.882780 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.882790 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.883334 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.883337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.883401 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.883443 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:20:50.884146 (+ 703us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:20:50.884158 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.884199 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.884272 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160}
I20260809 02:20:50.884411 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.879769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58004 (local address 127.1.81.193:34413)
0809 02:20:50.879924 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.879929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.880002 (+ 73us) server_negotiation.cc:407] Connection header received
0809 02:20:50.880242 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.880245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.880310 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.880425 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:50.880599 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.881409 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.882893 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.883239 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.883344 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.883561 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:50.884064 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:50.884173 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.884212 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.884266 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:20:50.889040 4581 raft_consensus.cc:1261] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Refusing update from remote peer 725d4abdc86c4121a4757a878b8da15e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:50.889046 4379 raft_consensus.cc:1261] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Refusing update from remote peer 725d4abdc86c4121a4757a878b8da15e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:50.889634 4708 consensus_queue.cc:1035] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:50.889828 4682 consensus_queue.cc:1035] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:50.892704 4683 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: TxnStatusTablet state changed. Reason: New leader 725d4abdc86c4121a4757a878b8da15e. Latest consensus state: current_term: 1 leader_uuid: "725d4abdc86c4121a4757a878b8da15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.892818 4683 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:50.893424 4684 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: TxnStatusTablet state changed. Reason: New leader 725d4abdc86c4121a4757a878b8da15e. Latest consensus state: current_term: 1 leader_uuid: "725d4abdc86c4121a4757a878b8da15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.893551 4684 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:50.896369 4682 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "725d4abdc86c4121a4757a878b8da15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.896493 4682 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:20:50.897250 4716 mvcc.cc:205] Tried to move back new op lower bound from 7316447440434688000 to 7316447440331862016. Current Snapshot: MvccSnapshot[applied={T|T < 7316447440434688000}]
I20260809 02:20:50.897487 4683 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "725d4abdc86c4121a4757a878b8da15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.897578 4683 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P c706aedf43514dddbb2650e4088fdabf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:50.897926 4684 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "725d4abdc86c4121a4757a878b8da15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.898025 4684 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 2491d9d8b1f24cb1a494f8d844222799: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:20:50.896389 4708 tablet_replica.cc:439] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "725d4abdc86c4121a4757a878b8da15e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } } }
I20260809 02:20:50.898144 4708 tablet_replica.cc:442] T d3ce6826bf3f45ed8b6bd9bb2b266873 P 725d4abdc86c4121a4757a878b8da15e: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:20:50.899797 4717 mvcc.cc:205] Tried to move back new op lower bound from 7316447440434688000 to 7316447440331862016. Current Snapshot: MvccSnapshot[applied={T|T < 7316447440434688000}]
I20260809 02:20:50.908454 4672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.904461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42776 (local address 127.1.81.194:40781)
0809 02:20:50.904563 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.904567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.904581 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:20:50.904656 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.904659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.904715 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.904814 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:50.905043 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.905813 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.906979 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.907315 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.907405 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.907657 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:50.908112 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:50.908221 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.908277 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.908334 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:20:50.923096 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.915993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:36611 (local address 127.1.81.193:34413)
0809 02:20:50.916093 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.916097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.920106 (+ 4009us) server_negotiation.cc:407] Connection header received
0809 02:20:50.920212 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.920214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.920256 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.920313 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:50.920540 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.921016 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.922189 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.922389 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.922453 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.922755 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:50.922816 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:50.922861 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.922958 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.923000 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:20:50.923238 4731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.915899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34413 (local address 127.1.81.194:36611)
0809 02:20:50.920015 (+ 4116us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.920029 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.920131 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.920334 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.920337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.920344 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:20:50.920459 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.920465 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.921105 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.921108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.922091 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.922102 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.922471 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.922475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.922567 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.922618 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:20:50.922883 (+ 265us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:20:50.922888 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.922941 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.923019 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4013,"thread_start_us":91,"threads_started":1}
W20260809 02:20:50.923609 4234 tablet.cc:2369] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:50.929885 4581 raft_consensus.cc:1261] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Refusing update from remote peer c706aedf43514dddbb2650e4088fdabf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:50.930076 4151 raft_consensus.cc:1261] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Refusing update from remote peer c706aedf43514dddbb2650e4088fdabf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:50.930388 4683 consensus_queue.cc:1035] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:50.930847 4683 consensus_queue.cc:1035] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [LEADER]: Connected to new peer: Peer: permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:50.952229 4672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.948396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:49017 (local address 127.1.81.194:40781)
0809 02:20:50.948519 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:50.948524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:50.948828 (+ 304us) server_negotiation.cc:407] Connection header received
0809 02:20:50.948963 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:50.948966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:50.949014 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:50.949080 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:50.949362 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.949838 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.951090 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.951416 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.951514 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.951855 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:50.951936 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:50.951994 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:50.952089 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 02:20:50.952129 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:20:50.952407 4739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:50.948110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40781 (local address 127.1.81.193:49017)
0809 02:20:50.948753 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:50.948768 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:50.948871 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:50.949102 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:50.949105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:50.949131 (+ 26us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:20:50.949266 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.949273 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.949925 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.949928 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.950937 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:50.950949 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:50.951509 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:50.951512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:50.951661 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:50.951716 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:20:50.952011 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:20:50.952017 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:20:50.952082 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:20:50.952160 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":114,"threads_started":1}
I20260809 02:20:50.974567 3922 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:50.974777 3922 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:50.977622 3922 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: Sending DeleteTablet for 3 replicas of tablet b8e78c261e0e41cf9de4a86a07f2186a
I20260809 02:20:50.978587 4123 tablet_service.cc:1514] Processing DeleteTablet for tablet b8e78c261e0e41cf9de4a86a07f2186a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:50 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58000
I20260809 02:20:50.979429 4553 tablet_service.cc:1514] Processing DeleteTablet for tablet b8e78c261e0e41cf9de4a86a07f2186a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:50 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:57710
I20260809 02:20:50.978504 4344 tablet_service.cc:1514] Processing DeleteTablet for tablet b8e78c261e0e41cf9de4a86a07f2186a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:50 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42772
I20260809 02:20:50.980823 4748 tablet_replica.cc:330] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: stopping tablet replica
I20260809 02:20:50.981027 4745 tablet_replica.cc:330] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: stopping tablet replica
I20260809 02:20:50.980947 3922 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:20:50.981338 3922 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:50.981707 4745 raft_consensus.cc:2229] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:50.981928 4748 raft_consensus.cc:2229] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:50.982610 4748 raft_consensus.cc:2258] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:50.982892 4745 raft_consensus.cc:2258] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:50.984535 4748 ts_tablet_manager.cc:1905] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:50.986380 4553 tablet_service.cc:1467] Processing CreateTablet for tablet 91913cb01106412682bacf2d8c3f0b2f (DEFAULT_TABLE table=test-table [id=5470178999494472b62abd9e4d400de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:50.986663 4553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91913cb01106412682bacf2d8c3f0b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.987880 4748 ts_tablet_manager.cc:1918] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:50.988047 4748 log.cc:1196] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/b8e78c261e0e41cf9de4a86a07f2186a
I20260809 02:20:50.988413 4748 ts_tablet_manager.cc:1939] T b8e78c261e0e41cf9de4a86a07f2186a P 725d4abdc86c4121a4757a878b8da15e: Deleting consensus metadata
I20260809 02:20:50.989105 4677 tablet_bootstrap.cc:492] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: Bootstrap starting.
I20260809 02:20:50.989291 4747 tablet_replica.cc:330] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: stopping tablet replica
I20260809 02:20:50.990041 4677 tablet_bootstrap.cc:654] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.990154 4747 raft_consensus.cc:2229] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:20:50.990623 4747 raft_consensus.cc:2258] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:50.990746 3898 catalog_manager.cc:4841] TS 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413): tablet b8e78c261e0e41cf9de4a86a07f2186a (table test-table [id=34c6f4da92204f83af09ab39a8685544]) successfully deleted
I20260809 02:20:50.991408 4123 tablet_service.cc:1467] Processing CreateTablet for tablet 91913cb01106412682bacf2d8c3f0b2f (DEFAULT_TABLE table=test-table [id=5470178999494472b62abd9e4d400de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:50.991693 4123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91913cb01106412682bacf2d8c3f0b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.991719 4344 tablet_service.cc:1467] Processing CreateTablet for tablet 91913cb01106412682bacf2d8c3f0b2f (DEFAULT_TABLE table=test-table [id=5470178999494472b62abd9e4d400de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:50.991986 4344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91913cb01106412682bacf2d8c3f0b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:50.993996 4676 tablet_bootstrap.cc:492] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: Bootstrap starting.
I20260809 02:20:50.995276 4676 tablet_bootstrap.cc:654] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.995442 4678 tablet_bootstrap.cc:492] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: Bootstrap starting.
I20260809 02:20:50.996393 4678 tablet_bootstrap.cc:654] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:50.997175 4747 ts_tablet_manager.cc:1905] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:50.999075 4745 ts_tablet_manager.cc:1905] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:50.999891 4676 tablet_bootstrap.cc:492] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: No bootstrap required, opened a new log
I20260809 02:20:50.999979 4676 ts_tablet_manager.cc:1397] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260809 02:20:51.000465 4678 tablet_bootstrap.cc:492] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: No bootstrap required, opened a new log
I20260809 02:20:51.000422 4676 raft_consensus.cc:348] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.000526 4676 raft_consensus.cc:374] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:51.000535 4678 ts_tablet_manager.cc:1397] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 02:20:51.000557 4676 raft_consensus.cc:729] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725d4abdc86c4121a4757a878b8da15e, State: Initialized, Role: FOLLOWER
I20260809 02:20:51.000694 4676 consensus_queue.cc:260] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.000942 4676 ts_tablet_manager.cc:1428] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:20:51.000941 4678 raft_consensus.cc:348] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.001037 4678 raft_consensus.cc:374] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:51.001070 4678 raft_consensus.cc:729] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c706aedf43514dddbb2650e4088fdabf, State: Initialized, Role: FOLLOWER
I20260809 02:20:51.001196 4678 consensus_queue.cc:260] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.001448 4678 ts_tablet_manager.cc:1428] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:51.001782 4745 ts_tablet_manager.cc:1918] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:51.001883 4745 log.cc:1196] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/b8e78c261e0e41cf9de4a86a07f2186a
I20260809 02:20:51.002180 4745 ts_tablet_manager.cc:1939] T b8e78c261e0e41cf9de4a86a07f2186a P 2491d9d8b1f24cb1a494f8d844222799: Deleting consensus metadata
I20260809 02:20:51.003319 3903 catalog_manager.cc:4841] TS 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837): tablet b8e78c261e0e41cf9de4a86a07f2186a (table test-table [id=34c6f4da92204f83af09ab39a8685544]) successfully deleted
I20260809 02:20:51.003356 4747 ts_tablet_manager.cc:1918] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:51.003654 4747 log.cc:1196] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/b8e78c261e0e41cf9de4a86a07f2186a
I20260809 02:20:51.004046 4747 ts_tablet_manager.cc:1939] T b8e78c261e0e41cf9de4a86a07f2186a P c706aedf43514dddbb2650e4088fdabf: Deleting consensus metadata
I20260809 02:20:51.005095 3900 catalog_manager.cc:4841] TS c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781): tablet b8e78c261e0e41cf9de4a86a07f2186a (table test-table [id=34c6f4da92204f83af09ab39a8685544]) successfully deleted
I20260809 02:20:51.006103 4677 tablet_bootstrap.cc:492] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: No bootstrap required, opened a new log
I20260809 02:20:51.006197 4677 ts_tablet_manager.cc:1397] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20260809 02:20:51.006912 4677 raft_consensus.cc:348] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.007030 4677 raft_consensus.cc:374] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:51.007064 4677 raft_consensus.cc:729] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2491d9d8b1f24cb1a494f8d844222799, State: Initialized, Role: FOLLOWER
I20260809 02:20:51.007191 4677 consensus_queue.cc:260] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.007493 4677 ts_tablet_manager.cc:1428] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 02:20:51.028609 4684 raft_consensus.cc:482] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:51.028733 4684 raft_consensus.cc:504] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.029836 4684 leader_election.cc:288] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413), c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781)
I20260809 02:20:51.034516 4491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.030016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34413 (local address 127.1.81.195:50303)
0809 02:20:51.030263 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:51.030278 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:51.030358 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:51.030898 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:51.030901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:51.030927 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:51.031040 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:51.031046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.031994 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.031997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:51.033226 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:51.033237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.034113 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.034117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:51.034217 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.034240 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:20:51.034305 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:20:51.034376 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"spinlock_wait_cycles":896}
I20260809 02:20:51.034966 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.030494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:50303 (local address 127.1.81.193:34413)
0809 02:20:51.030602 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:51.030606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:51.030617 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:20:51.030670 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:51.030673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:51.030711 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:51.030773 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:51.031158 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.031877 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.033377 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.033893 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.034000 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.034055 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:51.034773 (+ 718us) server_negotiation.cc:299] Negotiation successful
0809 02:20:51.034852 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:20:51.035037 4672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.030521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:42421 (local address 127.1.81.194:40781)
0809 02:20:51.030632 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:51.030636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:51.030850 (+ 214us) server_negotiation.cc:407] Connection header received
0809 02:20:51.031022 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:51.031025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:51.031068 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:51.031111 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:51.031479 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.032271 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.033852 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.034401 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.034501 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.034547 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:51.034864 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 02:20:51.034935 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:20:51.035352 4752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.030112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40781 (local address 127.1.81.195:42421)
0809 02:20:51.030773 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:51.030786 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:51.030917 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:51.031239 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:51.031242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:51.031258 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:51.031371 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:51.031376 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.032412 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.032415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:51.033738 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:51.033750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.034629 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.034633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:51.034727 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.034752 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:20:51.035158 (+ 406us) client_negotiation.cc:240] Negotiation successful
0809 02:20:51.035229 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":69,"threads_started":1}
I20260809 02:20:51.035326 4151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91913cb01106412682bacf2d8c3f0b2f" candidate_uuid: "2491d9d8b1f24cb1a494f8d844222799" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725d4abdc86c4121a4757a878b8da15e" is_pre_election: true
I20260809 02:20:51.035452 4151 raft_consensus.cc:2454] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2491d9d8b1f24cb1a494f8d844222799 in term 0.
I20260809 02:20:51.035856 4379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91913cb01106412682bacf2d8c3f0b2f" candidate_uuid: "2491d9d8b1f24cb1a494f8d844222799" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c706aedf43514dddbb2650e4088fdabf" is_pre_election: true
I20260809 02:20:51.035848 4480 leader_election.cc:302] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2491d9d8b1f24cb1a494f8d844222799, 725d4abdc86c4121a4757a878b8da15e; no voters:
I20260809 02:20:51.035986 4379 raft_consensus.cc:2454] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2491d9d8b1f24cb1a494f8d844222799 in term 0.
I20260809 02:20:51.036090 4684 raft_consensus.cc:2781] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:51.036136 4684 raft_consensus.cc:482] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:51.036170 4684 raft_consensus.cc:3037] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:51.037289 4684 raft_consensus.cc:504] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.037628 4684 leader_election.cc:288] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [CANDIDATE]: Term 1 election: Requested vote from peers 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413), c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781)
I20260809 02:20:51.037905 4379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91913cb01106412682bacf2d8c3f0b2f" candidate_uuid: "2491d9d8b1f24cb1a494f8d844222799" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c706aedf43514dddbb2650e4088fdabf"
I20260809 02:20:51.037936 4151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91913cb01106412682bacf2d8c3f0b2f" candidate_uuid: "2491d9d8b1f24cb1a494f8d844222799" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725d4abdc86c4121a4757a878b8da15e"
I20260809 02:20:51.038019 4379 raft_consensus.cc:3037] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:51.038043 4151 raft_consensus.cc:3037] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:51.038858 4379 raft_consensus.cc:2454] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2491d9d8b1f24cb1a494f8d844222799 in term 1.
I20260809 02:20:51.039042 4151 raft_consensus.cc:2454] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2491d9d8b1f24cb1a494f8d844222799 in term 1.
I20260809 02:20:51.039136 4481 leader_election.cc:302] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2491d9d8b1f24cb1a494f8d844222799, c706aedf43514dddbb2650e4088fdabf; no voters:
I20260809 02:20:51.039320 4684 raft_consensus.cc:2781] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:51.039515 4684 raft_consensus.cc:686] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 1 LEADER]: Becoming Leader. State: Replica: 2491d9d8b1f24cb1a494f8d844222799, State: Running, Role: LEADER
I20260809 02:20:51.039744 4684 consensus_queue.cc:237] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:51.041918 3922 catalog_manager.cc:5495] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195). New cstate: current_term: 1 leader_uuid: "2491d9d8b1f24cb1a494f8d844222799" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } health_report { overall_health: HEALTHY } } }
I20260809 02:20:51.064818 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.061306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57724 (local address 127.1.81.195:41837)
0809 02:20:51.061414 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:51.061418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:51.061432 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:20:51.061554 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:51.061557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:51.061611 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:51.061726 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:51.061877 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.062605 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.063355 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.063692 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.063786 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.064042 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:51.064438 (+ 396us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:51.064541 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:51.064658 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:20:51.064705 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:20:51.074506 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.071420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:53921 (local address 127.1.81.193:34413)
0809 02:20:51.071512 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:51.071515 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:51.071609 (+ 94us) server_negotiation.cc:407] Connection header received
0809 02:20:51.071733 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:51.071735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:51.071771 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:51.071847 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:51.072071 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.072507 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.073654 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.073844 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.073905 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.074185 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:51.074240 (+ 55us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:51.074283 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:51.074383 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 02:20:51.074418 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:20:51.074568 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.071346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34413 (local address 127.1.81.195:53921)
0809 02:20:51.071531 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:51.071560 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:51.071658 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:51.071880 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:51.071883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:51.071890 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:20:51.071991 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:51.071997 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.072603 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.072606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:51.073549 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:51.073560 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.073924 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.073928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:51.074024 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.074074 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:20:51.074308 (+ 234us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:20:51.074314 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:20:51.074377 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:20:51.074448 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260809 02:20:51.079988 4151 raft_consensus.cc:1261] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Refusing update from remote peer 2491d9d8b1f24cb1a494f8d844222799: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:51.080001 4379 raft_consensus.cc:1261] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Refusing update from remote peer 2491d9d8b1f24cb1a494f8d844222799: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:51.080494 4753 consensus_queue.cc:1035] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:51.080668 4684 consensus_queue.cc:1035] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:51.098233 4739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.094948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:41837 (local address 127.1.81.193:47345)
0809 02:20:51.095058 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:51.095072 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:51.095154 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:51.095454 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:51.095457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:51.095465 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:20:51.095545 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:51.095549 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.096447 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.096450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:51.097056 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:51.097066 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.097598 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.097601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:51.097679 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.097709 (+ 30us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:20:51.097968 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:20:51.097974 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:20:51.098031 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 02:20:51.098112 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:20:51.098636 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:51.095150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:47345 (local address 127.1.81.195:41837)
0809 02:20:51.095249 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:51.095253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:51.095267 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:20:51.095306 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:51.095308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:51.095349 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:51.095429 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:51.095649 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.096347 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.097179 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:51.097430 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:51.097528 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:51.097829 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:51.097890 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:51.097946 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:51.098476 (+ 530us) server_negotiation.cc:299] Negotiation successful
0809 02:20:51.098528 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 02:20:51.099231 4717 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 02:20:52.661192 3922 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:52.661362 3922 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:52.663666 3922 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: Sending DeleteTablet for 3 replicas of tablet 91913cb01106412682bacf2d8c3f0b2f
I20260809 02:20:52.664160 4122 tablet_service.cc:1514] Processing DeleteTablet for tablet 91913cb01106412682bacf2d8c3f0b2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58000
I20260809 02:20:52.664337 4344 tablet_service.cc:1514] Processing DeleteTablet for tablet 91913cb01106412682bacf2d8c3f0b2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42772
I20260809 02:20:52.664644 4553 tablet_service.cc:1514] Processing DeleteTablet for tablet 91913cb01106412682bacf2d8c3f0b2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:57710
I20260809 02:20:52.665035 4804 tablet_replica.cc:330] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: stopping tablet replica
I20260809 02:20:52.665191 4804 raft_consensus.cc:2229] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:20:52.665189 4802 tablet_replica.cc:330] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: stopping tablet replica
I20260809 02:20:52.665316 4802 raft_consensus.cc:2229] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:52.665422 4802 raft_consensus.cc:2258] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:52.665480 4804 raft_consensus.cc:2258] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:52.665753 4800 tablet_replica.cc:330] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: stopping tablet replica
I20260809 02:20:52.665926 4800 raft_consensus.cc:2229] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:52.666070 4800 raft_consensus.cc:2258] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:52.666069 4804 ts_tablet_manager.cc:1905] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:52.666069 4802 ts_tablet_manager.cc:1905] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:52.666725 4800 ts_tablet_manager.cc:1905] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:52.668817 4804 ts_tablet_manager.cc:1918] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:20:52.668817 4802 ts_tablet_manager.cc:1918] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:20:52.668896 4802 log.cc:1196] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/91913cb01106412682bacf2d8c3f0b2f
I20260809 02:20:52.668962 4804 log.cc:1196] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/91913cb01106412682bacf2d8c3f0b2f
I20260809 02:20:52.669165 4802 ts_tablet_manager.cc:1939] T 91913cb01106412682bacf2d8c3f0b2f P c706aedf43514dddbb2650e4088fdabf: Deleting consensus metadata
I20260809 02:20:52.669193 4800 ts_tablet_manager.cc:1918] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:20:52.669255 4804 ts_tablet_manager.cc:1939] T 91913cb01106412682bacf2d8c3f0b2f P 2491d9d8b1f24cb1a494f8d844222799: Deleting consensus metadata
I20260809 02:20:52.669258 4800 log.cc:1196] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/91913cb01106412682bacf2d8c3f0b2f
I20260809 02:20:52.669492 4800 ts_tablet_manager.cc:1939] T 91913cb01106412682bacf2d8c3f0b2f P 725d4abdc86c4121a4757a878b8da15e: Deleting consensus metadata
I20260809 02:20:52.669831 3903 catalog_manager.cc:4841] TS 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837): tablet 91913cb01106412682bacf2d8c3f0b2f (table test-table [id=5470178999494472b62abd9e4d400de9]) successfully deleted
I20260809 02:20:52.670001 3900 catalog_manager.cc:4841] TS c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781): tablet 91913cb01106412682bacf2d8c3f0b2f (table test-table [id=5470178999494472b62abd9e4d400de9]) successfully deleted
I20260809 02:20:52.670060 3898 catalog_manager.cc:4841] TS 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413): tablet 91913cb01106412682bacf2d8c3f0b2f (table test-table [id=5470178999494472b62abd9e4d400de9]) successfully deleted
Aug 09 02:20:52 dist-test-slave-jlzn krb5kdc[3855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242052, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:20:52 dist-test-slave-jlzn krb5kdc[3855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242052, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:52.694898 4813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:52.686277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58774 (local address 127.1.81.254:42505)
0809 02:20:52.686534 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:52.686544 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:52.686604 (+ 60us) server_negotiation.cc:407] Connection header received
0809 02:20:52.686747 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:52.686750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:52.686794 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:52.686868 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:52.687527 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:52.688124 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:52.689301 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:52.689561 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:52.689640 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:52.691941 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:52.691944 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:52.691946 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:52.691968 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:52.693347 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:52.693744 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:52.693747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:52.693749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:52.693828 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:52.694081 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:52.694084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:52.694085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:52.694266 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:52.694387 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:52.694618 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 02:20:52.694736 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":100,"threads_started":1}
I20260809 02:20:52.697158 3922 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58774:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:20:52.697576 3922 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:52.701961 4122 tablet_service.cc:1467] Processing CreateTablet for tablet 2223cc04def24f91833298ea0f84318e (DEFAULT_TABLE table=test-table [id=e11dd13f8024425eb2102499f4c3280f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:52.702099 4553 tablet_service.cc:1467] Processing CreateTablet for tablet 2223cc04def24f91833298ea0f84318e (DEFAULT_TABLE table=test-table [id=e11dd13f8024425eb2102499f4c3280f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:52.702088 4344 tablet_service.cc:1467] Processing CreateTablet for tablet 2223cc04def24f91833298ea0f84318e (DEFAULT_TABLE table=test-table [id=e11dd13f8024425eb2102499f4c3280f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:52.702292 4122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2223cc04def24f91833298ea0f84318e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:52.702368 4344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2223cc04def24f91833298ea0f84318e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:52.702368 4553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2223cc04def24f91833298ea0f84318e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:52.704659 4815 tablet_bootstrap.cc:492] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: Bootstrap starting.
I20260809 02:20:52.704936 4817 tablet_bootstrap.cc:492] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: Bootstrap starting.
I20260809 02:20:52.705076 4816 tablet_bootstrap.cc:492] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: Bootstrap starting.
I20260809 02:20:52.705554 4815 tablet_bootstrap.cc:654] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:52.705832 4817 tablet_bootstrap.cc:654] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:52.705860 4816 tablet_bootstrap.cc:654] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:52.706710 4815 tablet_bootstrap.cc:492] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: No bootstrap required, opened a new log
I20260809 02:20:52.706867 4815 ts_tablet_manager.cc:1397] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:52.707099 4817 tablet_bootstrap.cc:492] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: No bootstrap required, opened a new log
I20260809 02:20:52.707187 4817 ts_tablet_manager.cc:1397] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:52.707321 4816 tablet_bootstrap.cc:492] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: No bootstrap required, opened a new log
I20260809 02:20:52.707406 4816 ts_tablet_manager.cc:1397] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:52.707347 4815 raft_consensus.cc:348] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.707453 4815 raft_consensus.cc:374] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:52.707532 4815 raft_consensus.cc:729] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725d4abdc86c4121a4757a878b8da15e, State: Initialized, Role: FOLLOWER
I20260809 02:20:52.707568 4817 raft_consensus.cc:348] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.707669 4817 raft_consensus.cc:374] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:52.707738 4817 raft_consensus.cc:729] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2491d9d8b1f24cb1a494f8d844222799, State: Initialized, Role: FOLLOWER
I20260809 02:20:52.707700 4815 consensus_queue.cc:260] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.707913 4817 consensus_queue.cc:260] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.707829 4816 raft_consensus.cc:348] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.708003 4815 ts_tablet_manager.cc:1428] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:52.708071 4816 raft_consensus.cc:374] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:52.708140 4816 raft_consensus.cc:729] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c706aedf43514dddbb2650e4088fdabf, State: Initialized, Role: FOLLOWER
I20260809 02:20:52.708287 4817 ts_tablet_manager.cc:1428] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:52.708300 4816 consensus_queue.cc:260] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.708683 4816 ts_tablet_manager.cc:1428] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:52.831732 4821 raft_consensus.cc:482] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:52.831897 4821 raft_consensus.cc:504] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.832312 4821 leader_election.cc:288] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413), 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837)
I20260809 02:20:52.832759 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223cc04def24f91833298ea0f84318e" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2491d9d8b1f24cb1a494f8d844222799" is_pre_election: true
I20260809 02:20:52.832758 4151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223cc04def24f91833298ea0f84318e" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725d4abdc86c4121a4757a878b8da15e" is_pre_election: true
I20260809 02:20:52.832929 4151 raft_consensus.cc:2454] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 0.
I20260809 02:20:52.832929 4581 raft_consensus.cc:2454] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 0.
I20260809 02:20:52.833263 4272 leader_election.cc:302] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2491d9d8b1f24cb1a494f8d844222799, 725d4abdc86c4121a4757a878b8da15e, c706aedf43514dddbb2650e4088fdabf; no voters:
I20260809 02:20:52.833454 4821 raft_consensus.cc:2781] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:52.833520 4821 raft_consensus.cc:482] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:52.833556 4821 raft_consensus.cc:3037] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:52.834556 4821 raft_consensus.cc:504] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.834869 4821 leader_election.cc:288] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 election: Requested vote from peers 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413), 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837)
I20260809 02:20:52.835194 4151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223cc04def24f91833298ea0f84318e" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725d4abdc86c4121a4757a878b8da15e"
I20260809 02:20:52.835224 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2223cc04def24f91833298ea0f84318e" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2491d9d8b1f24cb1a494f8d844222799"
I20260809 02:20:52.835306 4151 raft_consensus.cc:3037] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:52.835333 4581 raft_consensus.cc:3037] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:52.836282 4581 raft_consensus.cc:2454] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 1.
I20260809 02:20:52.836297 4151 raft_consensus.cc:2454] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 1.
I20260809 02:20:52.836549 4272 leader_election.cc:302] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725d4abdc86c4121a4757a878b8da15e, c706aedf43514dddbb2650e4088fdabf; no voters:
I20260809 02:20:52.836724 4821 raft_consensus.cc:2781] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:52.836961 4821 raft_consensus.cc:686] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 1 LEADER]: Becoming Leader. State: Replica: c706aedf43514dddbb2650e4088fdabf, State: Running, Role: LEADER
I20260809 02:20:52.837097 4821 consensus_queue.cc:237] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.838665 3923 catalog_manager.cc:5495] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf reported cstate change: term changed from 0 to 1, leader changed from <none> to c706aedf43514dddbb2650e4088fdabf (127.1.81.194). New cstate: current_term: 1 leader_uuid: "c706aedf43514dddbb2650e4088fdabf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } health_report { overall_health: UNKNOWN } } }
I20260809 02:20:52.863039 4826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:52.860367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59346 (local address 127.1.81.194:40781)
0809 02:20:52.860605 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:52.860612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:52.860624 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:20:52.860663 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:52.860665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:52.860703 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:52.860772 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:52.860984 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:52.861496 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:52.862256 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:52.862465 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:52.862530 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:52.862721 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:52.862782 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:52.862828 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:52.862887 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 02:20:52.862929 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":98,"threads_started":1}
I20260809 02:20:52.869690 4580 raft_consensus.cc:1261] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Refusing update from remote peer c706aedf43514dddbb2650e4088fdabf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:52.870227 4828 consensus_queue.cc:1035] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:52.871411 4151 raft_consensus.cc:1261] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Refusing update from remote peer c706aedf43514dddbb2650e4088fdabf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:52.872674 4822 consensus_queue.cc:1035] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [LEADER]: Connected to new peer: Peer: permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:52.878633 4771 mvcc.cc:205] Tried to move back new op lower bound from 7316447448551084032 to 7316447448421978112. Current Snapshot: MvccSnapshot[applied={T|T < 7316447448551084032}]
I20260809 02:20:52.900981 3922 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:52.901110 3922 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:52.902863 3922 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: Sending DeleteTablet for 3 replicas of tablet 2223cc04def24f91833298ea0f84318e
I20260809 02:20:52.903347 4344 tablet_service.cc:1514] Processing DeleteTablet for tablet 2223cc04def24f91833298ea0f84318e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42772
I20260809 02:20:52.903347 4122 tablet_service.cc:1514] Processing DeleteTablet for tablet 2223cc04def24f91833298ea0f84318e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58000
I20260809 02:20:52.903421 4553 tablet_service.cc:1514] Processing DeleteTablet for tablet 2223cc04def24f91833298ea0f84318e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:52 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:57710
I20260809 02:20:52.903504 4802 tablet_replica.cc:330] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: stopping tablet replica
I20260809 02:20:52.903503 4800 tablet_replica.cc:330] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: stopping tablet replica
I20260809 02:20:52.903605 4800 raft_consensus.cc:2229] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:52.903605 4802 raft_consensus.cc:2229] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:20:52.903697 4800 raft_consensus.cc:2258] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:52.903769 4802 raft_consensus.cc:2258] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:52.903877 4804 tablet_replica.cc:330] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: stopping tablet replica
I20260809 02:20:52.903976 4804 raft_consensus.cc:2229] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:52.904071 4804 raft_consensus.cc:2258] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:52.904531 4802 ts_tablet_manager.cc:1905] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:52.904779 4800 ts_tablet_manager.cc:1905] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:52.907114 4802 ts_tablet_manager.cc:1918] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:52.907196 4802 log.cc:1196] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/2223cc04def24f91833298ea0f84318e
I20260809 02:20:52.907265 4800 ts_tablet_manager.cc:1918] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:52.907337 4800 log.cc:1196] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/2223cc04def24f91833298ea0f84318e
I20260809 02:20:52.907446 4802 ts_tablet_manager.cc:1939] T 2223cc04def24f91833298ea0f84318e P c706aedf43514dddbb2650e4088fdabf: Deleting consensus metadata
I20260809 02:20:52.907557 4800 ts_tablet_manager.cc:1939] T 2223cc04def24f91833298ea0f84318e P 725d4abdc86c4121a4757a878b8da15e: Deleting consensus metadata
I20260809 02:20:52.908111 3900 catalog_manager.cc:4841] TS c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781): tablet 2223cc04def24f91833298ea0f84318e (table test-table [id=e11dd13f8024425eb2102499f4c3280f]) successfully deleted
I20260809 02:20:52.908111 3898 catalog_manager.cc:4841] TS 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413): tablet 2223cc04def24f91833298ea0f84318e (table test-table [id=e11dd13f8024425eb2102499f4c3280f]) successfully deleted
I20260809 02:20:52.908566 3922 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58774:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 02:20:52.908792 4804 ts_tablet_manager.cc:1905] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 02:20:52.908955 3922 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:52.911237 4804 ts_tablet_manager.cc:1918] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:20:52.911309 4804 log.cc:1196] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/2223cc04def24f91833298ea0f84318e
I20260809 02:20:52.911556 4804 ts_tablet_manager.cc:1939] T 2223cc04def24f91833298ea0f84318e P 2491d9d8b1f24cb1a494f8d844222799: Deleting consensus metadata
I20260809 02:20:52.912168 3903 catalog_manager.cc:4841] TS 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837): tablet 2223cc04def24f91833298ea0f84318e (table test-table [id=e11dd13f8024425eb2102499f4c3280f]) successfully deleted
I20260809 02:20:52.913028 4122 tablet_service.cc:1467] Processing CreateTablet for tablet b913c3cd77624e8e957eee26cc643f1e (DEFAULT_TABLE table=test-table [id=0512f8ac19104a0aad417ed5c1d71046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:52.913209 4553 tablet_service.cc:1467] Processing CreateTablet for tablet b913c3cd77624e8e957eee26cc643f1e (DEFAULT_TABLE table=test-table [id=0512f8ac19104a0aad417ed5c1d71046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:52.913273 4122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b913c3cd77624e8e957eee26cc643f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:52.913220 4344 tablet_service.cc:1467] Processing CreateTablet for tablet b913c3cd77624e8e957eee26cc643f1e (DEFAULT_TABLE table=test-table [id=0512f8ac19104a0aad417ed5c1d71046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:52.913414 4553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b913c3cd77624e8e957eee26cc643f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:52.913452 4344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b913c3cd77624e8e957eee26cc643f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:52.915410 4815 tablet_bootstrap.cc:492] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e: Bootstrap starting.
I20260809 02:20:52.915462 4816 tablet_bootstrap.cc:492] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: Bootstrap starting.
I20260809 02:20:52.915479 4817 tablet_bootstrap.cc:492] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: Bootstrap starting.
I20260809 02:20:52.916218 4815 tablet_bootstrap.cc:654] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:52.916218 4816 tablet_bootstrap.cc:654] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:52.916242 4817 tablet_bootstrap.cc:654] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:52.917268 4817 tablet_bootstrap.cc:492] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: No bootstrap required, opened a new log
I20260809 02:20:52.917356 4817 ts_tablet_manager.cc:1397] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:52.917567 4815 tablet_bootstrap.cc:492] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e: No bootstrap required, opened a new log
I20260809 02:20:52.917569 4816 tablet_bootstrap.cc:492] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: No bootstrap required, opened a new log
I20260809 02:20:52.917640 4816 ts_tablet_manager.cc:1397] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:52.917652 4815 ts_tablet_manager.cc:1397] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:52.917707 4817 raft_consensus.cc:348] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.917788 4817 raft_consensus.cc:374] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:52.917806 4817 raft_consensus.cc:729] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2491d9d8b1f24cb1a494f8d844222799, State: Initialized, Role: FOLLOWER
I20260809 02:20:52.917902 4817 consensus_queue.cc:260] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.917985 4816 raft_consensus.cc:348] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.917985 4815 raft_consensus.cc:348] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.918081 4816 raft_consensus.cc:374] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:52.918082 4815 raft_consensus.cc:374] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:52.918113 4815 raft_consensus.cc:729] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725d4abdc86c4121a4757a878b8da15e, State: Initialized, Role: FOLLOWER
I20260809 02:20:52.918113 4816 raft_consensus.cc:729] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c706aedf43514dddbb2650e4088fdabf, State: Initialized, Role: FOLLOWER
I20260809 02:20:52.918128 4817 ts_tablet_manager.cc:1428] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:20:52.918228 4816 consensus_queue.cc:260] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.918227 4815 consensus_queue.cc:260] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.918480 4815 ts_tablet_manager.cc:1428] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:52.918480 4816 ts_tablet_manager.cc:1428] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:52.943931 4821 raft_consensus.cc:482] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:52.944018 4821 raft_consensus.cc:504] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.944376 4821 leader_election.cc:288] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413), 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837)
I20260809 02:20:52.944664 4151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b913c3cd77624e8e957eee26cc643f1e" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725d4abdc86c4121a4757a878b8da15e" is_pre_election: true
I20260809 02:20:52.944685 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b913c3cd77624e8e957eee26cc643f1e" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2491d9d8b1f24cb1a494f8d844222799" is_pre_election: true
I20260809 02:20:52.944780 4151 raft_consensus.cc:2454] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 0.
I20260809 02:20:52.944789 4581 raft_consensus.cc:2454] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 0.
I20260809 02:20:52.945042 4272 leader_election.cc:302] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2491d9d8b1f24cb1a494f8d844222799, 725d4abdc86c4121a4757a878b8da15e, c706aedf43514dddbb2650e4088fdabf; no voters:
I20260809 02:20:52.945228 4821 raft_consensus.cc:2781] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:52.945287 4821 raft_consensus.cc:482] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:52.945313 4821 raft_consensus.cc:3037] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:52.946095 4821 raft_consensus.cc:504] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.946421 4821 leader_election.cc:288] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 election: Requested vote from peers 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413), 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837)
I20260809 02:20:52.946707 4151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b913c3cd77624e8e957eee26cc643f1e" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725d4abdc86c4121a4757a878b8da15e"
I20260809 02:20:52.946728 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b913c3cd77624e8e957eee26cc643f1e" candidate_uuid: "c706aedf43514dddbb2650e4088fdabf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2491d9d8b1f24cb1a494f8d844222799"
I20260809 02:20:52.946811 4151 raft_consensus.cc:3037] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:52.946831 4581 raft_consensus.cc:3037] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:52.947589 4151 raft_consensus.cc:2454] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 1.
I20260809 02:20:52.947640 4581 raft_consensus.cc:2454] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c706aedf43514dddbb2650e4088fdabf in term 1.
I20260809 02:20:52.947855 4272 leader_election.cc:302] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725d4abdc86c4121a4757a878b8da15e, c706aedf43514dddbb2650e4088fdabf; no voters:
I20260809 02:20:52.948031 4821 raft_consensus.cc:2781] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:52.948117 4821 raft_consensus.cc:686] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 1 LEADER]: Becoming Leader. State: Replica: c706aedf43514dddbb2650e4088fdabf, State: Running, Role: LEADER
I20260809 02:20:52.948240 4821 consensus_queue.cc:237] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } }
I20260809 02:20:52.949620 3922 catalog_manager.cc:5495] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf reported cstate change: term changed from 0 to 1, leader changed from <none> to c706aedf43514dddbb2650e4088fdabf (127.1.81.194). New cstate: current_term: 1 leader_uuid: "c706aedf43514dddbb2650e4088fdabf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c706aedf43514dddbb2650e4088fdabf" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 } health_report { overall_health: UNKNOWN } } }
I20260809 02:20:52.966539 4581 raft_consensus.cc:1261] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Refusing update from remote peer c706aedf43514dddbb2650e4088fdabf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:52.966682 4151 raft_consensus.cc:1261] T b913c3cd77624e8e957eee26cc643f1e P 725d4abdc86c4121a4757a878b8da15e [term 1 FOLLOWER]: Refusing update from remote peer c706aedf43514dddbb2650e4088fdabf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:52.967026 4828 consensus_queue.cc:1035] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [LEADER]: Connected to new peer: Peer: permanent_uuid: "725d4abdc86c4121a4757a878b8da15e" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:52.967166 4821 consensus_queue.cc:1035] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2491d9d8b1f24cb1a494f8d844222799" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 02:20:52.979027 4776 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 02:20:54.524421 3922 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:54.524590 3922 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:54.526850 3922 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e11d16cc36894d78aec9cf036ebbc70d: Sending DeleteTablet for 3 replicas of tablet b913c3cd77624e8e957eee26cc643f1e
I20260809 02:20:54.527369 4344 tablet_service.cc:1514] Processing DeleteTablet for tablet b913c3cd77624e8e957eee26cc643f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:54 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42772
I20260809 02:20:54.527382 4553 tablet_service.cc:1514] Processing DeleteTablet for tablet b913c3cd77624e8e957eee26cc643f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:54 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:57710
I20260809 02:20:54.527457 4122 tablet_service.cc:1514] Processing DeleteTablet for tablet b913c3cd77624e8e957eee26cc643f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:54 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58000
I20260809 02:20:54.527729 4877 tablet_replica.cc:330] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: stopping tablet replica
I20260809 02:20:54.527835 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 4033
I20260809 02:20:54.527901 4877 raft_consensus.cc:2229] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:20:54.534570 4877 raft_consensus.cc:2258] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:54.535130 4877 ts_tablet_manager.cc:1905] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:54.537617 4877 ts_tablet_manager.cc:1918] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:20:54.537686 4877 log.cc:1196] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/b913c3cd77624e8e957eee26cc643f1e
I20260809 02:20:54.537919 4877 ts_tablet_manager.cc:1939] T b913c3cd77624e8e957eee26cc643f1e P c706aedf43514dddbb2650e4088fdabf: Deleting consensus metadata
I20260809 02:20:54.538360 4878 tablet_replica.cc:330] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: stopping tablet replica
I20260809 02:20:54.538504 4878 raft_consensus.cc:2229] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:54.538511 3900 catalog_manager.cc:4841] TS c706aedf43514dddbb2650e4088fdabf (127.1.81.194:40781): tablet b913c3cd77624e8e957eee26cc643f1e (table test-table [id=0512f8ac19104a0aad417ed5c1d71046]) successfully deleted
I20260809 02:20:54.538617 4878 raft_consensus.cc:2258] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:54.539180 4878 ts_tablet_manager.cc:1905] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:54.541757 4878 ts_tablet_manager.cc:1918] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:20:54.541841 4878 log.cc:1196] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/b913c3cd77624e8e957eee26cc643f1e
I20260809 02:20:54.542097 4878 ts_tablet_manager.cc:1939] T b913c3cd77624e8e957eee26cc643f1e P 2491d9d8b1f24cb1a494f8d844222799: Deleting consensus metadata
I20260809 02:20:54.542747 3903 catalog_manager.cc:4841] TS 2491d9d8b1f24cb1a494f8d844222799 (127.1.81.195:41837): tablet b913c3cd77624e8e957eee26cc643f1e (table test-table [id=0512f8ac19104a0aad417ed5c1d71046]) successfully deleted
W20260809 02:20:54.547919 3898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:34413 (error 108)
I20260809 02:20:54.548089 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 4245
I20260809 02:20:54.552433 4882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:54.551934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34413 (local address 127.0.0.1:42554)
0809 02:20:54.552253 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:54.552333 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:34413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":76,"threads_started":1}
W20260809 02:20:54.552574 3898 catalog_manager.cc:4584] TS 725d4abdc86c4121a4757a878b8da15e (127.1.81.193:34413): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b913c3cd77624e8e957eee26cc643f1e: Network error: Client connection negotiation failed: client connection to 127.1.81.193:34413: connect: Connection refused (error 111)
I20260809 02:20:54.557994 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 4456
I20260809 02:20:54.571092 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 3874
2026-08-09T02:20:54Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6083 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:54 dist-test-slave-jlzn krb5kdc[4885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:54 dist-test-slave-jlzn krb5kdc[4885](info): set up 2 sockets
Aug 09 02:20:54 dist-test-slave-jlzn krb5kdc[4885](info): commencing operation
krb5kdc: starting...
W20260809 02:20:55.702451 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:20:55 dist-test-slave-jlzn krb5kdc[4885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:20:55.814167 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:38413
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:38413
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:55.921123 4902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:55.921363 4902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:55.921417 4902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:55.925277 4902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:55.925328 4902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:55.925354 4902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:55.925377 4902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:55.925406 4902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:55.930379 4902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:38413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:38413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:55.931272 4902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:55.932235 4902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:55.940166 4912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:55.940223 4914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:55.940145 4911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:55.940325 4902 server_base.cc:1034] running on GCE node
I20260809 02:20:55.940876 4902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:55.941830 4902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:55.942986 4902 hybrid_clock.cc:648] HybridClock initialized: now 1786242055942968 us; error 32 us; skew 500 ppm
Aug 09 02:20:55 dist-test-slave-jlzn krb5kdc[4885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:55.945531 4902 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:20:55.946353 4902 webserver.cc:460] Webserver started at http://127.1.81.254:44755/ using document root <none> and password file <none>
I20260809 02:20:55.946848 4902 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:55.946914 4902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:55.947110 4902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:55.949028 4902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "6077504429464f43a0d7242fdff4e042"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-jlzn"
server_key: "ad826168a59d8fe9630e30bec2148b50"
server_key_iv: "1aba4b057d784bfbdaee66ead18edf75"
server_key_version: "encryptionkey@0"
I20260809 02:20:55.949558 4902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "6077504429464f43a0d7242fdff4e042"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-jlzn"
server_key: "ad826168a59d8fe9630e30bec2148b50"
server_key_iv: "1aba4b057d784bfbdaee66ead18edf75"
server_key_version: "encryptionkey@0"
I20260809 02:20:55.952929 4902 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:55.955015 4922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:55.956175 4902 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:55.956301 4902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "6077504429464f43a0d7242fdff4e042"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-jlzn"
server_key: "ad826168a59d8fe9630e30bec2148b50"
server_key_iv: "1aba4b057d784bfbdaee66ead18edf75"
server_key_version: "encryptionkey@0"
I20260809 02:20:55.956409 4902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:55.965626 4902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:55.968003 4902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:55.968166 4902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:55.974628 4902 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:38413
I20260809 02:20:55.974655 5001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:38413 every 8 connection(s)
I20260809 02:20:55.975440 4902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:55.977927 5002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:55.978814 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 4902
I20260809 02:20:55.978926 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:20:55.979214 1351 external_mini_cluster.cc:1428] Setting key 87a84b428fb7a5c349241a94e83ea17a
I20260809 02:20:55.983500 5002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042: Bootstrap starting.
I20260809 02:20:55.985535 5002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:55.986210 5002 log.cc:824] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:20:55 dist-test-slave-jlzn krb5kdc[4885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:55.988240 5002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042: No bootstrap required, opened a new log
I20260809 02:20:55.991853 5002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6077504429464f43a0d7242fdff4e042" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38413 } }
I20260809 02:20:55.992069 5002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:55.992132 5002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6077504429464f43a0d7242fdff4e042, State: Initialized, Role: FOLLOWER
I20260809 02:20:55.992189 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:55.980523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35922 (local address 127.1.81.254:38413)
0809 02:20:55.980933 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:55.980948 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:55.980981 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:20:55.981577 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:55.981593 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:55.981890 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:55.982169 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:55.982940 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.983935 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.984782 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.985242 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.985394 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:55.987995 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:55.988002 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:55.988016 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:55.988041 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:55.989541 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:55.990033 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:55.990037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:55.990041 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:55.990143 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:55.990409 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:55.990410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:55.990411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:55.990755 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:55.990898 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:55.991162 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 02:20:55.991387 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":127,"threads_started":1}
I20260809 02:20:55.992534 5002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6077504429464f43a0d7242fdff4e042" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38413 } }
I20260809 02:20:55.992668 5002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:55.992734 5002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:55.992830 5002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:55.993793 5002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6077504429464f43a0d7242fdff4e042" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38413 } }
I20260809 02:20:55.994128 5002 leader_election.cc:302] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6077504429464f43a0d7242fdff4e042; no voters:
I20260809 02:20:55.994407 5002 leader_election.cc:288] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:55.994489 5009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:55.994692 5009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [term 1 LEADER]: Becoming Leader. State: Replica: 6077504429464f43a0d7242fdff4e042, State: Running, Role: LEADER
I20260809 02:20:55.995005 5009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6077504429464f43a0d7242fdff4e042" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38413 } }
I20260809 02:20:55.995420 5002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:55.996536 5012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6077504429464f43a0d7242fdff4e042. Latest consensus state: current_term: 1 leader_uuid: "6077504429464f43a0d7242fdff4e042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6077504429464f43a0d7242fdff4e042" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38413 } } }
I20260809 02:20:55.996668 5012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:55.996732 5011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6077504429464f43a0d7242fdff4e042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6077504429464f43a0d7242fdff4e042" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38413 } } }
I20260809 02:20:55.996827 5011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:55.997998 5022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:56.000733 5022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:56.005522 5022 catalog_manager.cc:1347] Generated new cluster ID: c07a29ab5c24463e90f761c065168750
I20260809 02:20:56.005584 5022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:56.015904 5022 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:56.016762 5022 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:56.022533 5022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6077504429464f43a0d7242fdff4e042: Generated new TSK 0
I20260809 02:20:56.023221 5022 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:20:56.060546 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38413
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:56.189347 5039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:56.189568 5039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:56.189608 5039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:56.193434 5039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:56.193480 5039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:56.193533 5039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:20:56.198498 5039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:56.199328 5039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:56.200239 5039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:56.209085 5049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:56.209177 5047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:56.209084 5046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:56.209314 5039 server_base.cc:1034] running on GCE node
I20260809 02:20:56.209736 5039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:56.210322 5039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:56.211473 5039 hybrid_clock.cc:648] HybridClock initialized: now 1786242056211458 us; error 27 us; skew 500 ppm
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[4885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242056, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:56.214047 5039 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:20:56.214824 5039 webserver.cc:460] Webserver started at http://127.1.81.193:39003/ using document root <none> and password file <none>
I20260809 02:20:56.215320 5039 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:56.215381 5039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:56.215566 5039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:56.217501 5039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "4cc75d3f2d9a477f9bfc57dd2c896f0d"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "cb0fa7fc2074003dcb5eb381dee6bbd8"
server_key_iv: "41a99eca6bae90ef930bdc938db5ef45"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.218034 5039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "4cc75d3f2d9a477f9bfc57dd2c896f0d"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "cb0fa7fc2074003dcb5eb381dee6bbd8"
server_key_iv: "41a99eca6bae90ef930bdc938db5ef45"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.221625 5039 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 02:20:56.223774 5061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.224864 5039 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:56.224963 5039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "4cc75d3f2d9a477f9bfc57dd2c896f0d"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "cb0fa7fc2074003dcb5eb381dee6bbd8"
server_key_iv: "41a99eca6bae90ef930bdc938db5ef45"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.225054 5039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:56.237924 5039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:56.240381 5039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:56.240531 5039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:56.241034 5039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:56.241767 5039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:56.241813 5039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.241854 5039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:56.241883 5039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.250046 5039 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:38909
I20260809 02:20:56.250110 5236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:38909 every 8 connection(s)
I20260809 02:20:56.250828 5039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:56.256345 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 5039
I20260809 02:20:56.256451 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:56.256705 1351 external_mini_cluster.cc:1428] Setting key e1258dd60a5e2a17e17499abf4cc91f2
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[4885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242056, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:56.264461 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.252424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:49067 (local address 127.1.81.254:38413)
0809 02:20:56.252542 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.252546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.253278 (+ 732us) server_negotiation.cc:407] Connection header received
0809 02:20:56.254560 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.254564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.254623 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.254701 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:56.255784 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.256369 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.257616 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.257878 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.257975 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.260387 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:56.260392 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:56.260394 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:56.260422 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:56.261833 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.262305 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.262309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.262310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.262405 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.263183 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.263187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.263189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.263418 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:56.263519 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.264152 (+ 633us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.264295 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:20:56.265314 5242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.252709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38413 (local address 127.1.81.193:49067)
0809 02:20:56.253130 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.253178 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.254357 (+ 1179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.254872 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.254878 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.255209 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:56.255636 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.255649 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.256517 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.256520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.257500 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.257512 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.258028 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.258033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.258208 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.258708 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:56.258723 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:56.260225 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:56.261939 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:56.261944 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:56.261954 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:56.262211 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:56.262511 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:56.262514 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:56.262516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:56.262723 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:56.263551 (+ 828us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:56.263558 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:56.263884 (+ 326us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.264089 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.264409 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":110,"threads_started":1}
I20260809 02:20:56.266484 5238 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38413
I20260809 02:20:56.266690 5238 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:56.267129 5238 heartbeater.cc:511] Master 127.1.81.254:38413 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:20:56.268610 4953 ts_manager.cc:194] Registered new tserver with Master: 4cc75d3f2d9a477f9bfc57dd2c896f0d (127.1.81.193:38909)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
I20260809 02:20:56.269816 4953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:49067
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:20:56.283366 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38413
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:56.388996 5247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:56.389217 5247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:56.389256 5247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:56.393064 5247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:56.393106 5247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:56.393158 5247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:20:56.398129 5247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:56.398962 5247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:56.399848 5247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:56.408736 5257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:56.408733 5253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:56.408736 5255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:56.409016 5247 server_base.cc:1034] running on GCE node
I20260809 02:20:56.409435 5247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:56.409992 5247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:56.411166 5247 hybrid_clock.cc:648] HybridClock initialized: now 1786242056411144 us; error 23 us; skew 500 ppm
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[4885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242056, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:56.413769 5247 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:20:56.414542 5247 webserver.cc:460] Webserver started at http://127.1.81.194:46393/ using document root <none> and password file <none>
I20260809 02:20:56.415051 5247 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:56.415122 5247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:56.415318 5247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:56.417214 5247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "19c1b2c9c9b24f94a129cb9c7c833952"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "df5a3e663cdaec0cc44f24dba61ae2d4"
server_key_iv: "0056ed641d52a7d63aa69676778fa2ea"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.417749 5247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "19c1b2c9c9b24f94a129cb9c7c833952"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "df5a3e663cdaec0cc44f24dba61ae2d4"
server_key_iv: "0056ed641d52a7d63aa69676778fa2ea"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.421130 5247 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:56.423267 5269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.424374 5247 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:56.424490 5247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "19c1b2c9c9b24f94a129cb9c7c833952"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "df5a3e663cdaec0cc44f24dba61ae2d4"
server_key_iv: "0056ed641d52a7d63aa69676778fa2ea"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.424578 5247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:56.447923 5247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:56.450667 5247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:56.450829 5247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:56.451340 5247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:56.452099 5247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:56.452154 5247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.452205 5247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:56.452234 5247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.460587 5247 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:37845
I20260809 02:20:56.460609 5435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:37845 every 8 connection(s)
I20260809 02:20:56.461410 5247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:20:56.468327 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 5247
I20260809 02:20:56.468425 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:56.468712 1351 external_mini_cluster.cc:1428] Setting key f570144c16f0c626ee650ef18c30c8fe
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[4885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242056, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:56.473708 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.462959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:34317 (local address 127.1.81.254:38413)
0809 02:20:56.463086 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.463090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.464263 (+ 1173us) server_negotiation.cc:407] Connection header received
0809 02:20:56.465071 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.465074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.465131 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.465203 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:56.466242 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.466770 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.467865 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.468092 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.468181 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.470538 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:56.470542 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:56.470544 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:56.470569 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:56.471738 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.472212 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.472215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.472217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.472293 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.472606 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.472609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.472611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.472787 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:56.472868 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.473423 (+ 555us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.473541 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:20:56.474346 5444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.463279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38413 (local address 127.1.81.194:34317)
0809 02:20:56.464127 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.464174 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.464888 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.465365 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.465371 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.465684 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:56.466095 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.466106 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.466886 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.466889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.467736 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.467745 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.468232 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.468237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.468389 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.468916 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:56.468932 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:56.470395 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:56.471858 (+ 1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:56.471863 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:56.471876 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:56.472112 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:56.472375 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:56.472378 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:56.472380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:56.472510 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:56.472905 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:56.472912 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:56.473192 (+ 280us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.473344 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.473630 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":553,"threads_started":1}
I20260809 02:20:56.475342 5439 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38413
I20260809 02:20:56.475577 5439 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:56.476161 5439 heartbeater.cc:511] Master 127.1.81.254:38413 requested a full tablet report, sending...
I20260809 02:20:56.477247 4953 ts_manager.cc:194] Registered new tserver with Master: 19c1b2c9c9b24f94a129cb9c7c833952 (127.1.81.194:37845)
I20260809 02:20:56.478014 4953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:34317
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:20:56.494273 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38413
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:56.601094 5453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:56.601320 5453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:56.601374 5453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:56.605252 5453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:56.605301 5453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:56.605376 5453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:20:56.610271 5453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:56.611128 5453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:56.612040 5453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:56.620790 5462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:56.620849 5453 server_base.cc:1034] running on GCE node
W20260809 02:20:56.620801 5460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:56.620801 5464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:56.621369 5453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:56.621917 5453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:56.623075 5453 hybrid_clock.cc:648] HybridClock initialized: now 1786242056623054 us; error 31 us; skew 500 ppm
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[4885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242056, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:56.625625 5453 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:20:56.626356 5453 webserver.cc:460] Webserver started at http://127.1.81.195:38379/ using document root <none> and password file <none>
I20260809 02:20:56.626818 5453 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:56.626875 5453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:56.627060 5453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:56.628985 5453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "d7126dcea9f4452ab563c6cfb33e982f"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "803437af1e187ff24811c3f5b0687c1b"
server_key_iv: "44be0922957acf1837258b7f50ce0193"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.629526 5453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "d7126dcea9f4452ab563c6cfb33e982f"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "803437af1e187ff24811c3f5b0687c1b"
server_key_iv: "44be0922957acf1837258b7f50ce0193"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.632771 5453 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 02:20:56.634847 5472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.635916 5453 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:20:56.636021 5453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "d7126dcea9f4452ab563c6cfb33e982f"
format_stamp: "Formatted at 2026-08-09 02:20:56 on dist-test-slave-jlzn"
server_key: "803437af1e187ff24811c3f5b0687c1b"
server_key_iv: "44be0922957acf1837258b7f50ce0193"
server_key_version: "encryptionkey@0"
I20260809 02:20:56.636112 5453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:56.658414 5453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:56.660913 5453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:56.661063 5453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:56.661566 5453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:56.662288 5453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:56.662334 5453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.662374 5453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:56.662402 5453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.670607 5453 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:44957
I20260809 02:20:56.670636 5632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:44957 every 8 connection(s)
I20260809 02:20:56.671344 5453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:20:56.679448 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 5453
I20260809 02:20:56.679569 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:56.679901 1351 external_mini_cluster.cc:1428] Setting key aa1e1d85343255d8623be9df9a425631
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[4885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242056, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:56.683506 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.672919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:37331 (local address 127.1.81.254:38413)
0809 02:20:56.673051 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.673055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.674243 (+ 1188us) server_negotiation.cc:407] Connection header received
0809 02:20:56.675042 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.675046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.675104 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.675177 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:56.676318 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.676839 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.677916 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.678135 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.678224 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.680574 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:56.680578 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:56.680580 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:56.680602 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:56.681930 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.682366 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.682368 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.682370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.682444 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.682695 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.682696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.682697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.682847 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:56.682915 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.683293 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.683387 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:20:56.684237 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.673245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38413 (local address 127.1.81.195:37331)
0809 02:20:56.674100 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.674148 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.674857 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.675394 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.675401 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.675710 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:56.676178 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.676192 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.676954 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.676957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.677801 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.677811 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.678268 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.678273 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.678426 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.678846 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:56.678861 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:56.680414 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:56.682024 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:56.682029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:56.682039 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:56.682283 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:56.682505 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:56.682507 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:56.682508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:56.682624 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:56.682914 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:56.682918 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:56.683119 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.683263 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.683485 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":520,"threads_started":1}
I20260809 02:20:56.685168 5633 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38413
I20260809 02:20:56.685369 5633 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:56.685793 5633 heartbeater.cc:511] Master 127.1.81.254:38413 requested a full tablet report, sending...
I20260809 02:20:56.686682 4953 ts_manager.cc:194] Registered new tserver with Master: d7126dcea9f4452ab563c6cfb33e982f (127.1.81.195:44957)
I20260809 02:20:56.687211 4953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:37331
I20260809 02:20:56.693419 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:20:56.706996 5007 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:56.705808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35930 (local address 127.1.81.254:38413)
0809 02:20:56.705927 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.705930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.706107 (+ 177us) server_negotiation.cc:407] Connection header received
0809 02:20:56.706206 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.706208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.706243 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.706311 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:56.706884 (+ 573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35930: BlockingRecv error: recv got EOF from 127.0.0.1:35930 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:20:56.708101 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 5039
I20260809 02:20:56.720239 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 5247
I20260809 02:20:56.735792 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 5453
I20260809 02:20:56.746338 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 4902
2026-08-09T02:20:56Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2168 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[5655](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[5655](info): set up 2 sockets
Aug 09 02:20:56 dist-test-slave-jlzn krb5kdc[5655](info): commencing operation
krb5kdc: starting...
W20260809 02:20:57.876791 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:20:57 dist-test-slave-jlzn krb5kdc[5655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:20:57.999397 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41195
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:34813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:41195
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:58.105180 5670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:58.105417 5670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:58.105469 5670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:58.109333 5670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:58.109381 5670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:58.109407 5670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:58.109427 5670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:58.109453 5670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:58.114423 5670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:34813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:41195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:58.115306 5670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:58.116225 5670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:58.124063 5676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:58.124110 5670 server_base.cc:1034] running on GCE node
W20260809 02:20:58.124039 5677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:58.124056 5682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:58.124790 5670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:58.125790 5670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:58.126955 5670 hybrid_clock.cc:648] HybridClock initialized: now 1786242058126940 us; error 25 us; skew 500 ppm
Aug 09 02:20:58 dist-test-slave-jlzn krb5kdc[5655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242058, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:58.129534 5670 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:20:58.130312 5670 webserver.cc:460] Webserver started at http://127.1.81.254:40155/ using document root <none> and password file <none>
I20260809 02:20:58.130797 5670 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:58.130862 5670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:58.131048 5670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:58.132957 5670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "c8d20b8e46ba452dbf298830a4217567"
format_stamp: "Formatted at 2026-08-09 02:20:58 on dist-test-slave-jlzn"
server_key: "93b0df05437079d91486a7baefecf942"
server_key_iv: "c88c28d8cb3ad46e13b86cd29da6e7d9"
server_key_version: "encryptionkey@0"
I20260809 02:20:58.133491 5670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "c8d20b8e46ba452dbf298830a4217567"
format_stamp: "Formatted at 2026-08-09 02:20:58 on dist-test-slave-jlzn"
server_key: "93b0df05437079d91486a7baefecf942"
server_key_iv: "c88c28d8cb3ad46e13b86cd29da6e7d9"
server_key_version: "encryptionkey@0"
I20260809 02:20:58.136854 5670 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:58.139012 5692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:58.140192 5670 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:58.140306 5670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "c8d20b8e46ba452dbf298830a4217567"
format_stamp: "Formatted at 2026-08-09 02:20:58 on dist-test-slave-jlzn"
server_key: "93b0df05437079d91486a7baefecf942"
server_key_iv: "c88c28d8cb3ad46e13b86cd29da6e7d9"
server_key_version: "encryptionkey@0"
I20260809 02:20:58.140395 5670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:58.159029 5670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:58.161546 5670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:58.161718 5670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:58.168219 5670 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:41195
I20260809 02:20:58.168483 5761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:41195 every 8 connection(s)
I20260809 02:20:58.169103 5670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:58.171675 5762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:58.174137 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 5670
I20260809 02:20:58.174248 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:20:58.174484 1351 external_mini_cluster.cc:1428] Setting key b99af52f695a53f33eac8d90c5c6d368
I20260809 02:20:58.177639 5762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567: Bootstrap starting.
I20260809 02:20:58.179831 5762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:58.180523 5762 log.cc:824] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:58.182210 5762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567: No bootstrap required, opened a new log
Aug 09 02:20:58 dist-test-slave-jlzn krb5kdc[5655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:58.185221 5762 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d20b8e46ba452dbf298830a4217567" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41195 } }
I20260809 02:20:58.185420 5762 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:58.185453 5762 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d20b8e46ba452dbf298830a4217567, State: Initialized, Role: FOLLOWER
I20260809 02:20:58.185849 5762 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d20b8e46ba452dbf298830a4217567" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41195 } }
I20260809 02:20:58.185974 5762 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:58.186034 5762 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:58.186115 5762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:58.186899 5762 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d20b8e46ba452dbf298830a4217567" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41195 } }
I20260809 02:20:58.187207 5762 leader_election.cc:302] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8d20b8e46ba452dbf298830a4217567; no voters:
I20260809 02:20:58.187479 5762 leader_election.cc:288] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:58.187634 5772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:58.187825 5772 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [term 1 LEADER]: Becoming Leader. State: Replica: c8d20b8e46ba452dbf298830a4217567, State: Running, Role: LEADER
I20260809 02:20:58.188118 5772 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d20b8e46ba452dbf298830a4217567" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41195 } }
I20260809 02:20:58.188495 5770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:58.175610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35456 (local address 127.1.81.254:41195)
0809 02:20:58.176046 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:58.176065 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:58.176106 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:20:58.176895 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:58.176918 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:58.177306 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:58.177642 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:58.178386 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:58.179374 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:58.180296 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:58.180780 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:58.180928 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:58.183376 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:58.183381 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:58.183392 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:58.183418 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:58.185595 (+ 2177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:58.186037 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:58.186044 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:58.186048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:58.186169 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:58.186433 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:58.186436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:58.186438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:58.186803 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:58.187007 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:58.187270 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 02:20:58.187568 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":142,"threads_started":1}
I20260809 02:20:58.188695 5762 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:58.189682 5773 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8d20b8e46ba452dbf298830a4217567" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d20b8e46ba452dbf298830a4217567" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41195 } } }
I20260809 02:20:58.189807 5773 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:58.190078 5775 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8d20b8e46ba452dbf298830a4217567. Latest consensus state: current_term: 1 leader_uuid: "c8d20b8e46ba452dbf298830a4217567" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d20b8e46ba452dbf298830a4217567" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41195 } } }
I20260809 02:20:58.190155 5775 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:58.190537 5783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:58.191493 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:20:58.193708 5783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:58.199070 5783 catalog_manager.cc:1347] Generated new cluster ID: ede9db50c86b44b79ac3a0640128aeb1
I20260809 02:20:58.199131 5783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:58.205080 5783 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:58.206184 5783 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:58.212919 5783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8d20b8e46ba452dbf298830a4217567: Generated new TSK 0
I20260809 02:20:58.213528 5783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:20:58.213713 5770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:58.208757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35462 (local address 127.1.81.254:41195)
0809 02:20:58.208866 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:58.208871 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:58.209321 (+ 450us) server_negotiation.cc:407] Connection header received
0809 02:20:58.209433 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:58.209436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:58.209479 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:58.209541 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:58.210050 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:58.210575 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:58.211392 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:58.211638 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:58.211726 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:58.212749 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:58.212753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:58.212756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:58.213249 (+ 493us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:58.213283 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:58.213303 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:58.213393 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:58.213511 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 02:20:58.213570 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:20:58.222482 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 5670
2026-08-09T02:20:58Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1484 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:58 dist-test-slave-jlzn krb5kdc[5810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:58 dist-test-slave-jlzn krb5kdc[5810](info): set up 2 sockets
Aug 09 02:20:58 dist-test-slave-jlzn krb5kdc[5810](info): commencing operation
krb5kdc: starting...
W20260809 02:20:59.350723 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:20:59 dist-test-slave-jlzn krb5kdc[5810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:20:59.460016 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44841
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:44841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:59.566751 5835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:59.566982 5835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:59.567034 5835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:59.570945 5835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:59.570998 5835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:59.571025 5835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:59.571045 5835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:59.571067 5835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:59.576192 5835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:44841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:59.577085 5835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:59.577980 5835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:59.585865 5844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:59.585894 5848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:59.585888 5845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:59.586069 5835 server_base.cc:1034] running on GCE node
I20260809 02:20:59.586707 5835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:59.587693 5835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:59.588851 5835 hybrid_clock.cc:648] HybridClock initialized: now 1786242059588836 us; error 31 us; skew 500 ppm
Aug 09 02:20:59 dist-test-slave-jlzn krb5kdc[5810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242059, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:59.591354 5835 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:20:59.592216 5835 webserver.cc:460] Webserver started at http://127.1.81.254:39899/ using document root <none> and password file <none>
I20260809 02:20:59.592705 5835 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:59.592769 5835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:59.592953 5835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:59.594810 5835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "468e46e0e8cd4fc49e663ff2436af264"
format_stamp: "Formatted at 2026-08-09 02:20:59 on dist-test-slave-jlzn"
server_key: "c314fbbf006643c6c6aee1d47204cf61"
server_key_iv: "8c9932ae3099d9d6a93c694d4c2b69c0"
server_key_version: "encryptionkey@0"
I20260809 02:20:59.595333 5835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "468e46e0e8cd4fc49e663ff2436af264"
format_stamp: "Formatted at 2026-08-09 02:20:59 on dist-test-slave-jlzn"
server_key: "c314fbbf006643c6c6aee1d47204cf61"
server_key_iv: "8c9932ae3099d9d6a93c694d4c2b69c0"
server_key_version: "encryptionkey@0"
I20260809 02:20:59.598641 5835 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:20:59.600811 5857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:59.601845 5835 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:59.601964 5835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "468e46e0e8cd4fc49e663ff2436af264"
format_stamp: "Formatted at 2026-08-09 02:20:59 on dist-test-slave-jlzn"
server_key: "c314fbbf006643c6c6aee1d47204cf61"
server_key_iv: "8c9932ae3099d9d6a93c694d4c2b69c0"
server_key_version: "encryptionkey@0"
I20260809 02:20:59.602064 5835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:59.634835 5835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:59.637331 5835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:59.637490 5835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:59.643857 5835 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:44841
I20260809 02:20:59.644156 5931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:44841 every 8 connection(s)
I20260809 02:20:59.644737 5835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:59.647284 5933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:59.652390 5933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264: Bootstrap starting.
I20260809 02:20:59.654626 5933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:59.654960 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 5835
I20260809 02:20:59.655056 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:20:59.655305 1351 external_mini_cluster.cc:1428] Setting key e93ed1952a4c69ecec84cbfe582ee54b
I20260809 02:20:59.655356 5933 log.cc:824] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:59.657321 5933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264: No bootstrap required, opened a new log
I20260809 02:20:59.660569 5933 raft_consensus.cc:348] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468e46e0e8cd4fc49e663ff2436af264" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44841 } }
I20260809 02:20:59.660774 5933 raft_consensus.cc:374] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:59.660811 5933 raft_consensus.cc:729] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 468e46e0e8cd4fc49e663ff2436af264, State: Initialized, Role: FOLLOWER
I20260809 02:20:59.661204 5933 consensus_queue.cc:260] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468e46e0e8cd4fc49e663ff2436af264" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44841 } }
I20260809 02:20:59.661335 5933 raft_consensus.cc:388] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:59.661402 5933 raft_consensus.cc:482] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:59.661495 5933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:59.662324 5933 raft_consensus.cc:504] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468e46e0e8cd4fc49e663ff2436af264" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44841 } }
I20260809 02:20:59.662638 5933 leader_election.cc:302] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 468e46e0e8cd4fc49e663ff2436af264; no voters:
I20260809 02:20:59.662945 5933 leader_election.cc:288] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:59.663043 5939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 1 FOLLOWER]: Leader election won for term 1
Aug 09 02:20:59 dist-test-slave-jlzn krb5kdc[5810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:59.663257 5939 raft_consensus.cc:686] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [term 1 LEADER]: Becoming Leader. State: Replica: 468e46e0e8cd4fc49e663ff2436af264, State: Running, Role: LEADER
I20260809 02:20:59.663553 5939 consensus_queue.cc:237] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468e46e0e8cd4fc49e663ff2436af264" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44841 } }
I20260809 02:20:59.664201 5933 sys_catalog.cc:564] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:59.665164 5943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 468e46e0e8cd4fc49e663ff2436af264. Latest consensus state: current_term: 1 leader_uuid: "468e46e0e8cd4fc49e663ff2436af264" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468e46e0e8cd4fc49e663ff2436af264" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44841 } } }
I20260809 02:20:59.665194 5942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "468e46e0e8cd4fc49e663ff2436af264" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468e46e0e8cd4fc49e663ff2436af264" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44841 } } }
I20260809 02:20:59.665285 5943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:59.665295 5942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:59.665637 5945 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:59.668675 5945 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:59.670583 5938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:59.656299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.1.81.254:44841)
0809 02:20:59.656691 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:59.656705 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:59.656738 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:20:59.657342 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:59.657357 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:59.657673 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:59.657952 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:59.658740 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:59.659664 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:59.660542 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:59.661054 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:59.661204 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:59.663846 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:59.663853 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:59.663868 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:59.663898 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:59.665939 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:59.667917 (+ 1978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:59.667924 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:59.667930 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:59.668079 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:59.668426 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:59.668429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:59.668431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:59.668917 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:59.669141 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:59.669414 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 02:20:59.669707 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":108,"threads_started":1}
I20260809 02:20:59.674183 5945 catalog_manager.cc:1347] Generated new cluster ID: 19efb16668424a2c9cebce628662335a
I20260809 02:20:59.674242 5945 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:59.685612 5945 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:59.686722 5945 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:59.692646 5945 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 468e46e0e8cd4fc49e663ff2436af264: Generated new TSK 0
I20260809 02:20:59.693289 5945 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:20:59.722493 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44841
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:59.830142 5969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:59.830380 5969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:59.830437 5969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:59.834375 5969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:59.834430 5969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:59.834506 5969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:20:59.839422 5969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:20:59.840356 5969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:59.841257 5969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:59.850323 5977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:59.850358 5974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:59.850355 5975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:59.850471 5969 server_base.cc:1034] running on GCE node
I20260809 02:20:59.850879 5969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:59.851464 5969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:59.852619 5969 hybrid_clock.cc:648] HybridClock initialized: now 1786242059852604 us; error 27 us; skew 500 ppm
Aug 09 02:20:59 dist-test-slave-jlzn krb5kdc[5810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242059, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:59.855221 5969 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:20:59.856030 5969 webserver.cc:460] Webserver started at http://127.1.81.193:37099/ using document root <none> and password file <none>
I20260809 02:20:59.856531 5969 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:59.856599 5969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:59.856791 5969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:59.858691 5969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "228f7caa52954a7faa3d0fde60314dff"
format_stamp: "Formatted at 2026-08-09 02:20:59 on dist-test-slave-jlzn"
server_key: "d3c3be41406ddabd540367f35fc71c39"
server_key_iv: "8a385b154ad0583b16ca781b24c83215"
server_key_version: "encryptionkey@0"
I20260809 02:20:59.859246 5969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "228f7caa52954a7faa3d0fde60314dff"
format_stamp: "Formatted at 2026-08-09 02:20:59 on dist-test-slave-jlzn"
server_key: "d3c3be41406ddabd540367f35fc71c39"
server_key_iv: "8a385b154ad0583b16ca781b24c83215"
server_key_version: "encryptionkey@0"
I20260809 02:20:59.862747 5969 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:20:59.865185 5993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:59.866313 5969 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:59.866420 5969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "228f7caa52954a7faa3d0fde60314dff"
format_stamp: "Formatted at 2026-08-09 02:20:59 on dist-test-slave-jlzn"
server_key: "d3c3be41406ddabd540367f35fc71c39"
server_key_iv: "8a385b154ad0583b16ca781b24c83215"
server_key_version: "encryptionkey@0"
I20260809 02:20:59.866510 5969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:59.880488 5969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:59.883076 5969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:59.883240 5969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:59.883760 5969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:59.884545 5969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:59.884591 5969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:59.884634 5969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:59.884662 5969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:59.892650 5969 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:45179
I20260809 02:20:59.892719 6175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:45179 every 8 connection(s)
I20260809 02:20:59.893450 5969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:59.897996 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 5969
I20260809 02:20:59.898100 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:59.898352 1351 external_mini_cluster.cc:1428] Setting key f9e9946b6a47f0977e294dd975ed3613
Aug 09 02:20:59 dist-test-slave-jlzn krb5kdc[5810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242059, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:20:59.906876 5938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:59.895019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:52293 (local address 127.1.81.254:44841)
0809 02:20:59.895141 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:59.895145 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:59.895915 (+ 770us) server_negotiation.cc:407] Connection header received
0809 02:20:59.897264 (+ 1349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:59.897268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:59.897326 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:59.897395 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:59.898582 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:59.899233 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:59.900423 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:59.900665 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:59.900757 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:59.903304 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:59.903308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:59.903311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:59.903338 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:59.904885 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:59.905354 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:59.905358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:59.905360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:59.905455 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:59.905807 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:59.905810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:59.905812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:59.906034 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:59.906142 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:59.906572 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 02:20:59.906709 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":46}
I20260809 02:20:59.907474 6178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:59.895339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:44841 (local address 127.1.81.193:52293)
0809 02:20:59.895752 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:59.895793 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:59.897054 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:59.897564 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:59.897570 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:59.897929 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:59.898438 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:59.898454 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:59.899353 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:59.899355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:59.900305 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:59.900316 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:59.900803 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:59.900807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:59.900962 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:59.901474 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:59.901497 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:59.903150 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:59.904990 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:59.904994 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:59.905004 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:59.905262 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:59.905541 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:59.905543 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:59.905544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:59.905667 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:59.906132 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:59.906136 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:59.906351 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 02:20:59.906490 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 02:20:59.906713 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":114,"threads_started":1}
I20260809 02:20:59.908550 6176 heartbeater.cc:347] Connected to a master server at 127.1.81.254:44841
I20260809 02:20:59.908803 6176 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:20:59.909333 6176 heartbeater.cc:511] Master 127.1.81.254:44841 requested a full tablet report, sending...
I20260809 02:20:59.910748 5881 ts_manager.cc:194] Registered new tserver with Master: 228f7caa52954a7faa3d0fde60314dff (127.1.81.193:45179)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
I20260809 02:20:59.911983 5881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:52293
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:20:59.924168 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44841
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:00.029153 6182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:00.029359 6182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:00.029403 6182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:00.033252 6182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:00.033299 6182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:00.033365 6182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:00.038264 6182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:00.039116 6182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:00.040012 6182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:00.048951 6191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:00.048985 6192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:00.049005 6194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:00.049086 6182 server_base.cc:1034] running on GCE node
I20260809 02:21:00.049422 6182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:00.049979 6182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:00.051151 6182 hybrid_clock.cc:648] HybridClock initialized: now 1786242060051135 us; error 27 us; skew 500 ppm
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[5810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242060, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:00.053684 6182 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:21:00.054519 6182 webserver.cc:460] Webserver started at http://127.1.81.194:43155/ using document root <none> and password file <none>
I20260809 02:21:00.055102 6182 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:00.055177 6182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:00.055370 6182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:00.057272 6182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "436df7ecf8414c84b10ce12e8225d8b2"
format_stamp: "Formatted at 2026-08-09 02:21:00 on dist-test-slave-jlzn"
server_key: "7be21dbb56e17d924f61729ba1acb9f8"
server_key_iv: "446e1238eab24df7769dc8a6e1823757"
server_key_version: "encryptionkey@0"
I20260809 02:21:00.057781 6182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "436df7ecf8414c84b10ce12e8225d8b2"
format_stamp: "Formatted at 2026-08-09 02:21:00 on dist-test-slave-jlzn"
server_key: "7be21dbb56e17d924f61729ba1acb9f8"
server_key_iv: "446e1238eab24df7769dc8a6e1823757"
server_key_version: "encryptionkey@0"
I20260809 02:21:00.061133 6182 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:00.063270 6204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:00.064435 6182 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:00.064539 6182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "436df7ecf8414c84b10ce12e8225d8b2"
format_stamp: "Formatted at 2026-08-09 02:21:00 on dist-test-slave-jlzn"
server_key: "7be21dbb56e17d924f61729ba1acb9f8"
server_key_iv: "446e1238eab24df7769dc8a6e1823757"
server_key_version: "encryptionkey@0"
I20260809 02:21:00.064625 6182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:00.088373 6182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:00.090862 6182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:00.091022 6182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:00.091570 6182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:00.092339 6182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:00.092386 6182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:00.092427 6182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:00.092458 6182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:00.100759 6182 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:37487
I20260809 02:21:00.100788 6365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:37487 every 8 connection(s)
I20260809 02:21:00.101526 6182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:00.109306 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 6182
I20260809 02:21:00.109426 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:00.109737 1351 external_mini_cluster.cc:1428] Setting key 51c837917ccb57b8654b58b18b8693d2
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[5810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242060, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:00.114518 5938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:00.103117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:49835 (local address 127.1.81.254:44841)
0809 02:21:00.103254 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:00.103257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:00.103979 (+ 722us) server_negotiation.cc:407] Connection header received
0809 02:21:00.105326 (+ 1347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:00.105329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:00.105389 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:00.105459 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:00.106574 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.107096 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.108272 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.108496 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.108600 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:00.111135 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:00.111138 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:00.111140 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:00.111164 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:00.112600 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:00.113064 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:00.113068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:00.113069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:00.113163 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:00.113519 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:00.113521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:00.113522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:00.113695 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:00.113769 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:00.114305 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 02:21:00.114401 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:21:00.115473 6370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:00.103408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:44841 (local address 127.1.81.194:49835)
0809 02:21:00.103845 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:00.103886 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:00.105101 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:00.105630 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:00.105636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:00.105960 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:00.106430 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:00.106445 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.107217 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.107219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:00.108122 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:00.108132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.108642 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.108647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:00.108800 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:00.109265 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:00.109286 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:00.110967 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:00.112711 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:00.112715 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:00.112725 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:00.112967 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:00.113248 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:00.113251 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:00.113253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:00.113432 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:00.113788 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:00.113794 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:00.114074 (+ 280us) client_negotiation.cc:769] Sending connection context
0809 02:21:00.114269 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 02:21:00.114576 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":112,"threads_started":1}
I20260809 02:21:00.116590 6367 heartbeater.cc:347] Connected to a master server at 127.1.81.254:44841
I20260809 02:21:00.116806 6367 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:00.117247 6367 heartbeater.cc:511] Master 127.1.81.254:44841 requested a full tablet report, sending...
I20260809 02:21:00.118218 5881 ts_manager.cc:194] Registered new tserver with Master: 436df7ecf8414c84b10ce12e8225d8b2 (127.1.81.194:37487)
I20260809 02:21:00.118757 5881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:49835
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:21:00.135222 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44841
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:00.241560 6374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:00.241796 6374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:00.241851 6374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:00.245738 6374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:00.245784 6374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:00.245860 6374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:00.250801 6374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:00.251718 6374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:00.252646 6374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:00.261677 6379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:00.261654 6383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:00.261750 6374 server_base.cc:1034] running on GCE node
W20260809 02:21:00.261667 6381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:00.262306 6374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:00.262830 6374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:00.263993 6374 hybrid_clock.cc:648] HybridClock initialized: now 1786242060263975 us; error 26 us; skew 500 ppm
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[5810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242060, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:00.266552 6374 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:21:00.267374 6374 webserver.cc:460] Webserver started at http://127.1.81.195:38841/ using document root <none> and password file <none>
I20260809 02:21:00.267925 6374 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:00.267990 6374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:00.268234 6374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:00.270239 6374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "8f2a4e76273849e48f7474c8870ca25a"
format_stamp: "Formatted at 2026-08-09 02:21:00 on dist-test-slave-jlzn"
server_key: "1a618dc65724f38095d22b1f071e754c"
server_key_iv: "0e92c4369f9bb586724976fe2104c98e"
server_key_version: "encryptionkey@0"
I20260809 02:21:00.270767 6374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "8f2a4e76273849e48f7474c8870ca25a"
format_stamp: "Formatted at 2026-08-09 02:21:00 on dist-test-slave-jlzn"
server_key: "1a618dc65724f38095d22b1f071e754c"
server_key_iv: "0e92c4369f9bb586724976fe2104c98e"
server_key_version: "encryptionkey@0"
I20260809 02:21:00.274159 6374 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:00.276355 6395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:00.277578 6374 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:00.277697 6374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "8f2a4e76273849e48f7474c8870ca25a"
format_stamp: "Formatted at 2026-08-09 02:21:00 on dist-test-slave-jlzn"
server_key: "1a618dc65724f38095d22b1f071e754c"
server_key_iv: "0e92c4369f9bb586724976fe2104c98e"
server_key_version: "encryptionkey@0"
I20260809 02:21:00.277802 6374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:00.305644 6374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:00.308190 6374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:00.308331 6374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:00.308841 6374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:00.309648 6374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:00.309706 6374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:00.309746 6374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:00.309767 6374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:00.317852 6374 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:33401
I20260809 02:21:00.317909 6561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:33401 every 8 connection(s)
I20260809 02:21:00.318657 6374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:00.320304 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 6374
I20260809 02:21:00.320403 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:00.320643 1351 external_mini_cluster.cc:1428] Setting key 304ba7ec7d0ed9aabff801352d345f66
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[5810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242060, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:00.330682 5938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:00.320269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:56085 (local address 127.1.81.254:44841)
0809 02:21:00.320418 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:00.320423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:00.321210 (+ 787us) server_negotiation.cc:407] Connection header received
0809 02:21:00.322568 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:00.322571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:00.322620 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:00.322681 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:00.323743 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.324311 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.325476 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.325707 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.325791 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:00.328009 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:00.328012 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:00.328014 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:00.328039 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:00.329127 (+ 1088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:00.329550 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:00.329552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:00.329554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:00.329628 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:00.329873 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:00.329875 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:00.329876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:00.330031 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:00.330108 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:00.330480 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 02:21:00.330566 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:21:00.331360 6566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:00.320601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:44841 (local address 127.1.81.195:56085)
0809 02:21:00.321059 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:00.321109 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:00.322382 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:00.322822 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:00.322828 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:00.323160 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:00.323586 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:00.323599 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.324432 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.324435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:00.325356 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:00.325367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.325839 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.325843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:00.325997 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:00.326477 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:00.326493 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:00.327865 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:00.329231 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:00.329235 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:00.329245 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:00.329478 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:00.329690 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:00.329692 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:00.329694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:00.329810 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:00.330106 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:00.330110 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:00.330310 (+ 200us) client_negotiation.cc:769] Sending connection context
0809 02:21:00.330448 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 02:21:00.330673 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":120,"threads_started":1}
I20260809 02:21:00.332367 6562 heartbeater.cc:347] Connected to a master server at 127.1.81.254:44841
I20260809 02:21:00.332566 6562 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:00.333019 6562 heartbeater.cc:511] Master 127.1.81.254:44841 requested a full tablet report, sending...
I20260809 02:21:00.333971 5880 ts_manager.cc:194] Registered new tserver with Master: 8f2a4e76273849e48f7474c8870ca25a (127.1.81.195:33401)
I20260809 02:21:00.334537 5880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:56085
I20260809 02:21:00.345427 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[5810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242060, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[5810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242060, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:00.369580 5938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:00.362334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56872 (local address 127.1.81.254:44841)
0809 02:21:00.362457 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:00.362461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:00.362630 (+ 169us) server_negotiation.cc:407] Connection header received
0809 02:21:00.362730 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:00.362732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:00.362770 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:00.362831 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:00.363423 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.363944 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.364712 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:00.364914 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:00.364979 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:00.367027 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:00.367030 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:00.367032 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:00.367060 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:00.368304 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:00.368669 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:00.368672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:00.368673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:00.368747 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:00.368918 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:00.368920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:00.368921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:00.369114 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:00.369211 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:00.369356 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 02:21:00.369437 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 02:21:00.369956 5880 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56872
I20260809 02:21:00.370604 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 5969
I20260809 02:21:00.385244 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 6182
I20260809 02:21:00.399261 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 6374
I20260809 02:21:00.411428 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 5835
2026-08-09T02:21:00Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2182 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[6584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[6584](info): set up 2 sockets
Aug 09 02:21:00 dist-test-slave-jlzn krb5kdc[6584](info): commencing operation
krb5kdc: starting...
W20260809 02:21:01.525357 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:01 dist-test-slave-jlzn krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:21:01.636286 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:39327
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:39327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:01.742602 6605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:01.742841 6605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:01.742894 6605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:01.746783 6605 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:01.746832 6605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:01.746860 6605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:01.746881 6605 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:01.746906 6605 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:01.751885 6605 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:39327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:39327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:01.752748 6605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:01.753607 6605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:21:01.761308 6605 server_base.cc:1034] running on GCE node
W20260809 02:21:01.761262 6611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:01.761262 6612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:01.761252 6615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:01.762017 6605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:01.763005 6605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:01.764159 6605 hybrid_clock.cc:648] HybridClock initialized: now 1786242061764139 us; error 33 us; skew 500 ppm
Aug 09 02:21:01 dist-test-slave-jlzn krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242061, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:01.766665 6605 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:21:01.767437 6605 webserver.cc:460] Webserver started at http://127.1.81.254:33491/ using document root <none> and password file <none>
I20260809 02:21:01.767973 6605 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:01.768041 6605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:01.768234 6605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:01.770071 6605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "2a932fe143ad4f29be3e39bd0b34a095"
format_stamp: "Formatted at 2026-08-09 02:21:01 on dist-test-slave-jlzn"
server_key: "5053c1fce5065910128acd7ac1bab76f"
server_key_iv: "9f56937b1eca5e31d71705b94a5a646a"
server_key_version: "encryptionkey@0"
I20260809 02:21:01.770610 6605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "2a932fe143ad4f29be3e39bd0b34a095"
format_stamp: "Formatted at 2026-08-09 02:21:01 on dist-test-slave-jlzn"
server_key: "5053c1fce5065910128acd7ac1bab76f"
server_key_iv: "9f56937b1eca5e31d71705b94a5a646a"
server_key_version: "encryptionkey@0"
I20260809 02:21:01.773980 6605 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:21:01.776149 6625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:01.777225 6605 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:01.777346 6605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "2a932fe143ad4f29be3e39bd0b34a095"
format_stamp: "Formatted at 2026-08-09 02:21:01 on dist-test-slave-jlzn"
server_key: "5053c1fce5065910128acd7ac1bab76f"
server_key_iv: "9f56937b1eca5e31d71705b94a5a646a"
server_key_version: "encryptionkey@0"
I20260809 02:21:01.777434 6605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:01.790252 6605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:01.792759 6605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:01.792917 6605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:01.799153 6605 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:39327
I20260809 02:21:01.799198 6700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:39327 every 8 connection(s)
I20260809 02:21:01.800022 6605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:01.800894 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 6605
I20260809 02:21:01.801007 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:01.801317 1351 external_mini_cluster.cc:1428] Setting key 7a79ebd6cf2c733a38a0e750eb909d45
I20260809 02:21:01.802863 6702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:01.808955 6702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095: Bootstrap starting.
Aug 09 02:21:01 dist-test-slave-jlzn krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:01.811327 6702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:01.812107 6702 log.cc:824] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:01.813954 6702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095: No bootstrap required, opened a new log
I20260809 02:21:01.814500 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:01.802500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51376 (local address 127.1.81.254:39327)
0809 02:21:01.802884 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:01.802899 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:01.802932 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:21:01.803544 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:01.803559 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:01.803898 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:01.804154 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:01.805008 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:01.805965 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:01.807091 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:01.807519 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:01.807643 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:01.810243 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:01.810248 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:01.810259 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:01.810285 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:01.811839 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:01.812324 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:01.812329 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:01.812334 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:01.812443 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:01.812738 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:01.812740 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:01.812741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:01.813094 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:01.813273 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:01.813560 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 02:21:01.813818 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":120,"threads_started":1}
I20260809 02:21:01.817605 6702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a932fe143ad4f29be3e39bd0b34a095" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39327 } }
I20260809 02:21:01.817839 6702 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:01.817945 6702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a932fe143ad4f29be3e39bd0b34a095, State: Initialized, Role: FOLLOWER
I20260809 02:21:01.818400 6702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a932fe143ad4f29be3e39bd0b34a095" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39327 } }
I20260809 02:21:01.818549 6702 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:01.818615 6702 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:01.818709 6702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:01.819496 6702 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a932fe143ad4f29be3e39bd0b34a095" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39327 } }
I20260809 02:21:01.819846 6702 leader_election.cc:302] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a932fe143ad4f29be3e39bd0b34a095; no voters:
I20260809 02:21:01.820147 6702 leader_election.cc:288] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:01.820266 6709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:01.820523 6709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [term 1 LEADER]: Becoming Leader. State: Replica: 2a932fe143ad4f29be3e39bd0b34a095, State: Running, Role: LEADER
I20260809 02:21:01.820807 6709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a932fe143ad4f29be3e39bd0b34a095" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39327 } }
I20260809 02:21:01.821317 6702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:01.822458 6712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a932fe143ad4f29be3e39bd0b34a095. Latest consensus state: current_term: 1 leader_uuid: "2a932fe143ad4f29be3e39bd0b34a095" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a932fe143ad4f29be3e39bd0b34a095" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39327 } } }
I20260809 02:21:01.822491 6710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a932fe143ad4f29be3e39bd0b34a095" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a932fe143ad4f29be3e39bd0b34a095" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39327 } } }
I20260809 02:21:01.822691 6710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:01.822726 6712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:01.823483 6720 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:01.825918 6720 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:01.830928 6720 catalog_manager.cc:1347] Generated new cluster ID: c361154e0be1423bab824cf2aff6b6eb
I20260809 02:21:01.830987 6720 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:01.847648 6720 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:01.848471 6720 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:01.854338 6720 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a932fe143ad4f29be3e39bd0b34a095: Generated new TSK 0
I20260809 02:21:01.854876 6720 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:21:01.887625 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:39327
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:01.995190 6736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:01.995407 6736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:01.995446 6736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:01.999300 6736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:01.999344 6736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:01.999396 6736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:02.004338 6736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:39327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:02.005194 6736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:02.006081 6736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:21:02.015204 6736 server_base.cc:1034] running on GCE node
W20260809 02:21:02.015122 6742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:02.015079 6747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:02.015077 6745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:02.015735 6736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:02.016353 6736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:02.017554 6736 hybrid_clock.cc:648] HybridClock initialized: now 1786242062017516 us; error 27 us; skew 500 ppm
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:02.020218 6736 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:21:02.021001 6736 webserver.cc:460] Webserver started at http://127.1.81.193:35117/ using document root <none> and password file <none>
I20260809 02:21:02.021562 6736 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:02.021662 6736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:02.021878 6736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:02.024080 6736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "5ac1402c8fa74e409fce433c9626d1be"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "959ec3c610fa363f9061458872bae688"
server_key_iv: "7ddeae5628d73cc9c548f6abe2560ec4"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.024598 6736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "5ac1402c8fa74e409fce433c9626d1be"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "959ec3c610fa363f9061458872bae688"
server_key_iv: "7ddeae5628d73cc9c548f6abe2560ec4"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.028023 6736 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:21:02.030220 6758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.031293 6736 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:02.031401 6736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "5ac1402c8fa74e409fce433c9626d1be"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "959ec3c610fa363f9061458872bae688"
server_key_iv: "7ddeae5628d73cc9c548f6abe2560ec4"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.031488 6736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:02.071374 6736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:02.073931 6736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:02.074092 6736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:02.074616 6736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:02.075390 6736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:02.075438 6736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.075490 6736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:02.075515 6736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.084061 6736 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:34973
I20260809 02:21:02.084136 6931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:34973 every 8 connection(s)
I20260809 02:21:02.084883 6736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:02.093276 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 6736
I20260809 02:21:02.093405 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:02.093693 1351 external_mini_cluster.cc:1428] Setting key bfb4e9ec3ad01c15ba4b6fa25890cca2
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:02.097949 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:02.086456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:49157 (local address 127.1.81.254:39327)
0809 02:21:02.086580 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:02.086584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:02.087355 (+ 771us) server_negotiation.cc:407] Connection header received
0809 02:21:02.088711 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:02.088714 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:02.088775 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:02.088845 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:02.089916 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.090454 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.091569 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.091838 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.091936 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:02.094432 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:02.094436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:02.094439 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:02.094462 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:02.095975 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.096513 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.096515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.096516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.096608 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.096943 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.096945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.096946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.097139 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:02.097236 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:02.097671 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 02:21:02.097790 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:21:02.098590 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:02.086767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:39327 (local address 127.1.81.193:49157)
0809 02:21:02.087212 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:02.087252 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:02.088499 (+ 1247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:02.089017 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:02.089023 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:02.089352 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:02.089775 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:02.089787 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.090574 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.090578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:02.091435 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:02.091444 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.091977 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.091981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:02.092151 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:02.092752 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:02.092769 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:02.094266 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:02.096085 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:02.096090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:02.096104 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:02.096425 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:02.096685 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:02.096688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:02.096690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:02.096867 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:02.097246 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:02.097251 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:02.097463 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 02:21:02.097607 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 02:21:02.097840 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":107,"threads_started":1}
I20260809 02:21:02.099673 6932 heartbeater.cc:347] Connected to a master server at 127.1.81.254:39327
I20260809 02:21:02.099962 6932 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:02.100510 6932 heartbeater.cc:511] Master 127.1.81.254:39327 requested a full tablet report, sending...
I20260809 02:21:02.102007 6648 ts_manager.cc:194] Registered new tserver with Master: 5ac1402c8fa74e409fce433c9626d1be (127.1.81.193:34973)
I20260809 02:21:02.103075 6648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:49157
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:21:02.119771 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:39327
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:02.225862 6940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:02.226082 6940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:02.226126 6940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:02.230013 6940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:02.230060 6940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:02.230146 6940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:02.235224 6940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:39327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:02.236114 6940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:02.237053 6940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:02.245937 6951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:02.245945 6953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:02.245965 6950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:02.246084 6940 server_base.cc:1034] running on GCE node
I20260809 02:21:02.246534 6940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:02.247105 6940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:02.248266 6940 hybrid_clock.cc:648] HybridClock initialized: now 1786242062248248 us; error 28 us; skew 500 ppm
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:02.250725 6940 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:21:02.251519 6940 webserver.cc:460] Webserver started at http://127.1.81.194:46485/ using document root <none> and password file <none>
I20260809 02:21:02.252065 6940 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:02.252133 6940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:02.252333 6940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:02.254168 6940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "5dd58c27899a464797d44b109c56aa47"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "f9797f373bd1eebc13b19dba6a4c6f3d"
server_key_iv: "937a598d12044aca1dacc29d669db1de"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.254680 6940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "5dd58c27899a464797d44b109c56aa47"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "f9797f373bd1eebc13b19dba6a4c6f3d"
server_key_iv: "937a598d12044aca1dacc29d669db1de"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.258111 6940 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:21:02.260270 6968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.261322 6940 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:02.261426 6940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "5dd58c27899a464797d44b109c56aa47"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "f9797f373bd1eebc13b19dba6a4c6f3d"
server_key_iv: "937a598d12044aca1dacc29d669db1de"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.261513 6940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:02.276270 6940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:02.278656 6940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:02.278812 6940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:02.279338 6940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:02.280133 6940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:02.280189 6940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.280241 6940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:02.280267 6940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.289417 6940 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:34273
I20260809 02:21:02.289459 7135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:34273 every 8 connection(s)
I20260809 02:21:02.290208 6940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:02.295056 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 6940
I20260809 02:21:02.295171 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:02.295418 1351 external_mini_cluster.cc:1428] Setting key d353551d11fbc496399bb79040664517
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:02.302939 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:02.291856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:43913 (local address 127.1.81.254:39327)
0809 02:21:02.291973 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:02.291977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:02.292747 (+ 770us) server_negotiation.cc:407] Connection header received
0809 02:21:02.294022 (+ 1275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:02.294025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:02.294073 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:02.294142 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:02.295204 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.295781 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.296914 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.297137 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.297234 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:02.299450 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:02.299453 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:02.299455 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:02.299479 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:02.300918 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.301397 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.301401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.301403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.301515 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.301862 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.301865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.301867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.302091 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:02.302212 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:02.302643 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 02:21:02.302774 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:21:02.303546 7140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:02.292179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:39327 (local address 127.1.81.194:43913)
0809 02:21:02.292599 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:02.292639 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:02.293847 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:02.294281 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:02.294288 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:02.294607 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:02.295052 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:02.295065 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.295923 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.295927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:02.296796 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:02.296805 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.297281 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.297285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:02.297443 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:02.297949 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:02.297965 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:02.299295 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:02.301028 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:02.301032 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:02.301042 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:02.301288 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:02.301596 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:02.301598 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:02.301600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:02.301770 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:02.302205 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:02.302209 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:02.302414 (+ 205us) client_negotiation.cc:769] Sending connection context
0809 02:21:02.302554 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 02:21:02.302789 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":114,"threads_started":1}
I20260809 02:21:02.304621 7137 heartbeater.cc:347] Connected to a master server at 127.1.81.254:39327
I20260809 02:21:02.304862 7137 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:02.305425 7137 heartbeater.cc:511] Master 127.1.81.254:39327 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
I20260809 02:21:02.306444 6648 ts_manager.cc:194] Registered new tserver with Master: 5dd58c27899a464797d44b109c56aa47 (127.1.81.194:34273)
I20260809 02:21:02.307003 6648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:43913
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:21:02.321772 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:39327
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:02.433197 7145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:02.433426 7145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:02.433465 7145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:02.437474 7145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:02.437522 7145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:02.437582 7145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:02.442505 7145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:39327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:02.443358 7145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:02.444300 7145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:02.453377 7153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:02.453354 7152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:02.453380 7158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:02.453528 7145 server_base.cc:1034] running on GCE node
I20260809 02:21:02.453975 7145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:02.454535 7145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:02.455699 7145 hybrid_clock.cc:648] HybridClock initialized: now 1786242062455685 us; error 23 us; skew 500 ppm
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:02.458235 7145 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:21:02.459009 7145 webserver.cc:460] Webserver started at http://127.1.81.195:46833/ using document root <none> and password file <none>
I20260809 02:21:02.459501 7145 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:02.459565 7145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:02.459766 7145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:02.461898 7145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "376f06feb381401d8b433bda1a16256d"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "932fcb989fe0377bdfafe9bc3fc4160f"
server_key_iv: "2b0a2c9b849006a45b8316e63fc94712"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.462492 7145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "376f06feb381401d8b433bda1a16256d"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "932fcb989fe0377bdfafe9bc3fc4160f"
server_key_iv: "2b0a2c9b849006a45b8316e63fc94712"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.465962 7145 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 02:21:02.468194 7167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.469262 7145 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:02.469370 7145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "376f06feb381401d8b433bda1a16256d"
format_stamp: "Formatted at 2026-08-09 02:21:02 on dist-test-slave-jlzn"
server_key: "932fcb989fe0377bdfafe9bc3fc4160f"
server_key_iv: "2b0a2c9b849006a45b8316e63fc94712"
server_key_version: "encryptionkey@0"
I20260809 02:21:02.469455 7145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:02.486449 7145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:02.489342 7145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:02.489506 7145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:02.490042 7145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:02.490818 7145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:02.490864 7145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.490914 7145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:02.490943 7145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:02.501245 7145 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:46029
I20260809 02:21:02.501271 7337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:46029 every 8 connection(s)
I20260809 02:21:02.502050 7145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:02.507349 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 7145
I20260809 02:21:02.507467 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:02.507709 1351 external_mini_cluster.cc:1428] Setting key b905e1b2b5ca1d51f585c39615ee3c25
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:02.514477 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:02.503742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:41871 (local address 127.1.81.254:39327)
0809 02:21:02.503914 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:02.503917 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:02.504663 (+ 746us) server_negotiation.cc:407] Connection header received
0809 02:21:02.506008 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:02.506011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:02.506069 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:02.506141 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:02.507278 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.507915 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.509233 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.509457 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.509561 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:02.511789 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:02.511792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:02.511794 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:02.511843 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:02.512927 (+ 1084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.513357 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.513359 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.513360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.513427 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.513672 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.513674 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.513675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.513829 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:02.513898 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:02.514271 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 02:21:02.514361 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 02:21:02.515179 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:02.504086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:39327 (local address 127.1.81.195:41871)
0809 02:21:02.504506 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:02.504547 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:02.505793 (+ 1246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:02.506325 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:02.506332 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:02.506656 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:02.507101 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:02.507114 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.508037 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.508040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:02.509117 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:02.509127 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.509602 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.509606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:02.509794 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:02.510297 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:02.510313 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:02.511628 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:02.513023 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:02.513027 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:02.513037 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:02.513280 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:02.513484 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:02.513486 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:02.513488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:02.513604 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:02.513897 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:02.513901 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:02.514101 (+ 200us) client_negotiation.cc:769] Sending connection context
0809 02:21:02.514240 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 02:21:02.514460 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":101,"threads_started":1}
I20260809 02:21:02.516185 7338 heartbeater.cc:347] Connected to a master server at 127.1.81.254:39327
I20260809 02:21:02.516373 7338 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:02.516772 7338 heartbeater.cc:511] Master 127.1.81.254:39327 requested a full tablet report, sending...
I20260809 02:21:02.517668 6648 ts_manager.cc:194] Registered new tserver with Master: 376f06feb381401d8b433bda1a16256d (127.1.81.195:46029)
I20260809 02:21:02.518191 6648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:41871
I20260809 02:21:02.521175 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:21:02.546765 7349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:02.538211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34356 (local address 127.1.81.193:34973)
0809 02:21:02.538555 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:02.538571 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:02.538600 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:21:02.538657 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:02.538663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:02.538870 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:02.539003 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:02.539592 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.540399 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.541275 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.541603 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.541677 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:02.543782 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:02.543792 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:02.543827 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:02.543855 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:02.545110 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.545513 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.545518 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.545519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.545601 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.545852 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.545856 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.545858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.546078 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:02.546307 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:02.546459 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 02:21:02.546601 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":127,"threads_started":1}
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:02.556118 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:02.549410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51382 (local address 127.1.81.254:39327)
0809 02:21:02.549537 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:02.549540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:02.549590 (+ 50us) server_negotiation.cc:407] Connection header received
0809 02:21:02.549681 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:02.549683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:02.549718 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:02.549779 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:02.550253 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.550733 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.551388 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:02.551588 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:02.551658 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:02.553680 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:02.553683 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:02.553685 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:02.553708 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:02.554905 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.555206 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.555208 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.555209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.555273 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:02.555436 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:02.555438 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:02.555439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:02.555617 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:02.555717 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:02.555910 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 02:21:02.556006 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 02:21:02.556448 6648 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51382
I20260809 02:21:02.556960 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 6736
I20260809 02:21:02.569295 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 6940
I20260809 02:21:02.577870 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 7145
I20260809 02:21:02.587920 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 6605
2026-08-09T02:21:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2175 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[7358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[7358](info): set up 2 sockets
Aug 09 02:21:02 dist-test-slave-jlzn krb5kdc[7358](info): commencing operation
krb5kdc: starting...
W20260809 02:21:03.703017 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:03 dist-test-slave-jlzn krb5kdc[7358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:21:03.815992 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:45797
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:45797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:03.922264 7382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:03.922487 7382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:03.922524 7382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:03.926370 7382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:03.926414 7382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:03.926430 7382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:03.926450 7382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:03.926470 7382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:03.931397 7382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:45797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:45797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:03.932257 7382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:03.933100 7382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:03.940876 7388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:03.940933 7387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:03.940879 7391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:03.941138 7382 server_base.cc:1034] running on GCE node
I20260809 02:21:03.941710 7382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:03.942647 7382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:03.943819 7382 hybrid_clock.cc:648] HybridClock initialized: now 1786242063943782 us; error 36 us; skew 500 ppm
Aug 09 02:21:03 dist-test-slave-jlzn krb5kdc[7358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242063, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:03.946369 7382 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:21:03.947023 7382 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:03.947093 7382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:03.947289 7382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:03.949172 7382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "3ead0161732742548145b7e91340289d"
format_stamp: "Formatted at 2026-08-09 02:21:03 on dist-test-slave-jlzn"
server_key: "7e65c6daf86283ea82a5d93f29bb7100"
server_key_iv: "fe5ccf5eaf55f15ae9594c4657f5fd28"
server_key_version: "encryptionkey@0"
I20260809 02:21:03.949697 7382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "3ead0161732742548145b7e91340289d"
format_stamp: "Formatted at 2026-08-09 02:21:03 on dist-test-slave-jlzn"
server_key: "7e65c6daf86283ea82a5d93f29bb7100"
server_key_iv: "fe5ccf5eaf55f15ae9594c4657f5fd28"
server_key_version: "encryptionkey@0"
I20260809 02:21:03.953089 7382 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:03.955178 7400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:03.956269 7382 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:03.956388 7382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "3ead0161732742548145b7e91340289d"
format_stamp: "Formatted at 2026-08-09 02:21:03 on dist-test-slave-jlzn"
server_key: "7e65c6daf86283ea82a5d93f29bb7100"
server_key_iv: "fe5ccf5eaf55f15ae9594c4657f5fd28"
server_key_version: "encryptionkey@0"
I20260809 02:21:03.956476 7382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:03.968036 7382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:03.970786 7382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:03.970938 7382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:03.977411 7382 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:45797
I20260809 02:21:03.977632 7468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:45797 every 8 connection(s)
I20260809 02:21:03.977962 7382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:03.980430 7469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:03.981009 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 7382
I20260809 02:21:03.981117 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:03.981351 1351 external_mini_cluster.cc:1428] Setting key 544fecf0d248a9c0a88ff31503915b2a
I20260809 02:21:03.986114 7469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d: Bootstrap starting.
I20260809 02:21:03.988662 7469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:03.989465 7469 log.cc:824] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:21:03 dist-test-slave-jlzn krb5kdc[7358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:03.991561 7469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d: No bootstrap required, opened a new log
I20260809 02:21:03.994867 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:03.982493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49646 (local address 127.1.81.254:45797)
0809 02:21:03.982875 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:03.982888 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:03.982920 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:21:03.983536 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:03.983552 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:03.983873 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:03.984128 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:03.984969 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:03.985917 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:03.987073 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:03.987525 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:03.987633 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:03.990242 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:03.990248 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:03.990263 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:03.990291 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:03.992060 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:03.992456 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:03.992462 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:03.992467 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:03.992605 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:03.992828 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:03.992831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:03.992833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:03.993313 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:03.993504 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:03.993699 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 02:21:03.993996 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":107,"threads_started":1}
I20260809 02:21:03.995729 7469 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead0161732742548145b7e91340289d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45797 } }
I20260809 02:21:03.996014 7469 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:03.996089 7469 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ead0161732742548145b7e91340289d, State: Initialized, Role: FOLLOWER
I20260809 02:21:03.996531 7469 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead0161732742548145b7e91340289d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45797 } }
I20260809 02:21:03.996691 7469 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:03.996757 7469 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:03.996851 7469 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:03.997677 7469 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead0161732742548145b7e91340289d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45797 } }
I20260809 02:21:03.997975 7469 leader_election.cc:302] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ead0161732742548145b7e91340289d; no voters:
I20260809 02:21:03.998235 7469 leader_election.cc:288] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:03.998342 7480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:03.998558 7480 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [term 1 LEADER]: Becoming Leader. State: Replica: 3ead0161732742548145b7e91340289d, State: Running, Role: LEADER
I20260809 02:21:03.998907 7480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead0161732742548145b7e91340289d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45797 } }
I20260809 02:21:03.999423 7469 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:04.000345 7482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ead0161732742548145b7e91340289d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead0161732742548145b7e91340289d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45797 } } }
I20260809 02:21:04.000485 7482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:04.000857 7490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:04.000886 7481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ead0161732742548145b7e91340289d. Latest consensus state: current_term: 1 leader_uuid: "3ead0161732742548145b7e91340289d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead0161732742548145b7e91340289d" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 45797 } } }
I20260809 02:21:04.001492 7481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:04.003973 7490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:04.009074 7490 catalog_manager.cc:1347] Generated new cluster ID: 9c0c20bf56a64f6e8a07b8832055505d
I20260809 02:21:04.009132 7490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:04.022878 7490 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:04.024070 7490 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:04.028577 7490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d: Generated new TSK 0
I20260809 02:21:04.029137 7490 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:21:04.056133 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45797
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:04.171766 7505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:04.172010 7505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:04.172055 7505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:04.175997 7505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:04.176045 7505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:04.176112 7505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:04.181113 7505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:04.182044 7505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:04.182977 7505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:04.192070 7514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:04.192088 7520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:04.192091 7511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:04.192462 7505 server_base.cc:1034] running on GCE node
I20260809 02:21:04.192840 7505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:04.193375 7505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:04.194521 7505 hybrid_clock.cc:648] HybridClock initialized: now 1786242064194496 us; error 37 us; skew 500 ppm
Aug 09 02:21:04 dist-test-slave-jlzn krb5kdc[7358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242064, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:04.197218 7505 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:21:04.197922 7505 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:04.197991 7505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:04.198189 7505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:04.200210 7505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "755a8b99d1e6421689430f776eb9f429"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "d01786f160f0024e2f713f6b4f85234c"
server_key_iv: "e087fc5bba2f84c12ff6e1238a93d3de"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.200788 7505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "755a8b99d1e6421689430f776eb9f429"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "d01786f160f0024e2f713f6b4f85234c"
server_key_iv: "e087fc5bba2f84c12ff6e1238a93d3de"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.204231 7505 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:04.206432 7532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.207527 7505 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:04.207634 7505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "755a8b99d1e6421689430f776eb9f429"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "d01786f160f0024e2f713f6b4f85234c"
server_key_iv: "e087fc5bba2f84c12ff6e1238a93d3de"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.207731 7505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:04.229565 7505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:04.232491 7505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:04.232658 7505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:04.233180 7505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:04.233963 7505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:04.234010 7505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.234061 7505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:04.234086 7505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.242354 7505 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:44755
I20260809 02:21:04.242375 7699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:44755 every 8 connection(s)
I20260809 02:21:04.242874 7505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:21:04 dist-test-slave-jlzn krb5kdc[7358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242064, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:04.251997 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 7505
I20260809 02:21:04.252120 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:04.252416 1351 external_mini_cluster.cc:1428] Setting key fa3dacdb4ada2864055b154165af0966
I20260809 02:21:04.255554 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.244614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:59531 (local address 127.1.81.254:45797)
0809 02:21:04.244739 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.244743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.245515 (+ 772us) server_negotiation.cc:407] Connection header received
0809 02:21:04.246755 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.246758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.246807 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.246880 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:04.248016 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.248567 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.249687 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.249933 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.250026 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.252313 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:04.252316 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:04.252318 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:04.252343 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:04.253678 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:04.254208 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:04.254210 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:04.254211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:04.254282 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:04.254609 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:04.254611 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:04.254612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:04.254776 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:04.254845 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.255342 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.255437 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:21:04.256502 7702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.244942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45797 (local address 127.1.81.193:59531)
0809 02:21:04.245365 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.245406 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.246563 (+ 1157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.247023 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.247029 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.247381 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:04.247869 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.247886 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.248702 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.248705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.249561 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.249571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.250073 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.250077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.250244 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.250671 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:04.250687 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:04.252148 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:04.253773 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:04.253779 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:04.253792 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:04.254119 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:04.254351 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:04.254353 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:04.254355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:04.254527 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:04.254859 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:04.254865 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:04.255133 (+ 268us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.255322 (+ 189us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.255619 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":114,"threads_started":1}
I20260809 02:21:04.257557 7700 heartbeater.cc:347] Connected to a master server at 127.1.81.254:45797
I20260809 02:21:04.257791 7700 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:04.258245 7700 heartbeater.cc:511] Master 127.1.81.254:45797 requested a full tablet report, sending...
I20260809 02:21:04.259747 7423 ts_manager.cc:194] Registered new tserver with Master: 755a8b99d1e6421689430f776eb9f429 (127.1.81.193:44755)
I20260809 02:21:04.260895 7423 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:59531
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:21:04.278053 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45797
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:04.386237 7706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:04.386468 7706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:04.386528 7706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:04.390451 7706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:04.390502 7706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:04.390580 7706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:04.395579 7706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:04.396488 7706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:04.397410 7706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:21:04.406342 7706 server_base.cc:1034] running on GCE node
W20260809 02:21:04.406267 7723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:04.406270 7717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:04.406270 7718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:04.406952 7706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:04.407548 7706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:04.408703 7706 hybrid_clock.cc:648] HybridClock initialized: now 1786242064408674 us; error 42 us; skew 500 ppm
Aug 09 02:21:04 dist-test-slave-jlzn krb5kdc[7358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242064, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:04.411441 7706 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:21:04.412195 7706 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:04.412268 7706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:04.412464 7706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:04.414361 7706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "44c1801d0e4b4f9e81b677295213d613"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "0e2cac14eb992415dd25d95ba93c3164"
server_key_iv: "67b0eb03ffdf7e8f2b23f384da789b87"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.414887 7706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "44c1801d0e4b4f9e81b677295213d613"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "0e2cac14eb992415dd25d95ba93c3164"
server_key_iv: "67b0eb03ffdf7e8f2b23f384da789b87"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.418426 7706 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 02:21:04.420652 7730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.421732 7706 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:04.421839 7706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "44c1801d0e4b4f9e81b677295213d613"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "0e2cac14eb992415dd25d95ba93c3164"
server_key_iv: "67b0eb03ffdf7e8f2b23f384da789b87"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.421928 7706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:04.431932 7706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:04.434762 7706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:04.434917 7706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:04.435418 7706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:04.436206 7706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:04.436254 7706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.436303 7706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:04.436331 7706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.444721 7706 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:33827
I20260809 02:21:04.444742 7904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:33827 every 8 connection(s)
I20260809 02:21:04.445209 7706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:04.453297 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 7706
I20260809 02:21:04.453406 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:04.453675 1351 external_mini_cluster.cc:1428] Setting key 2406863ec1b30e3ff70ff37183161b4e
Aug 09 02:21:04 dist-test-slave-jlzn krb5kdc[7358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242064, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:04.457692 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.446734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:35173 (local address 127.1.81.254:45797)
0809 02:21:04.446866 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.446870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.447584 (+ 714us) server_negotiation.cc:407] Connection header received
0809 02:21:04.448874 (+ 1290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.448877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.448934 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.449007 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:04.450066 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.450596 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.451711 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.451976 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.452062 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.454304 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:04.454308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:04.454310 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:04.454340 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:04.455822 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:04.456275 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:04.456278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:04.456280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:04.456370 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:04.456637 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:04.456640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:04.456641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:04.456854 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:04.456948 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.457379 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.457506 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:21:04.458333 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.447029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45797 (local address 127.1.81.194:35173)
0809 02:21:04.447451 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.447490 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.448679 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.449173 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.449179 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.449495 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:04.449925 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.449937 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.450719 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.450722 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.451583 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.451593 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.452123 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.452128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.452281 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.452690 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:04.452706 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:04.454166 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:04.455926 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:04.455930 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:04.455940 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:04.456186 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:04.456445 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:04.456447 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:04.456448 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:04.456563 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:04.456936 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:04.456940 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:04.457156 (+ 216us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.457311 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.457587 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":109,"threads_started":1}
I20260809 02:21:04.459331 7905 heartbeater.cc:347] Connected to a master server at 127.1.81.254:45797
I20260809 02:21:04.459537 7905 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:04.459983 7905 heartbeater.cc:511] Master 127.1.81.254:45797 requested a full tablet report, sending...
I20260809 02:21:04.460973 7423 ts_manager.cc:194] Registered new tserver with Master: 44c1801d0e4b4f9e81b677295213d613 (127.1.81.194:33827)
I20260809 02:21:04.461503 7423 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:35173
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:21:04.478502 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45797
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:04.585460 7910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:04.585690 7910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:04.585731 7910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:04.589658 7910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:04.589708 7910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:04.589762 7910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:04.594657 7910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:45797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:04.595471 7910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:04.596364 7910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:04.605044 7923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:04.605031 7918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:04.605087 7910 server_base.cc:1034] running on GCE node
W20260809 02:21:04.605239 7921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:04.605608 7910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:04.606165 7910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:04.607309 7910 hybrid_clock.cc:648] HybridClock initialized: now 1786242064607287 us; error 34 us; skew 500 ppm
Aug 09 02:21:04 dist-test-slave-jlzn krb5kdc[7358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242064, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:04.609817 7910 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:21:04.610452 7910 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:04.610514 7910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:04.610707 7910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:04.612604 7910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "45bb586a89db40059a027d04c86a420e"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "9f0780826ca6d9c6b86a98288a75f4ad"
server_key_iv: "72ba82d4ce81067e413ef86b6b3e064f"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.613143 7910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "45bb586a89db40059a027d04c86a420e"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "9f0780826ca6d9c6b86a98288a75f4ad"
server_key_iv: "72ba82d4ce81067e413ef86b6b3e064f"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.616425 7910 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:21:04.618532 7931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.619591 7910 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:21:04.619712 7910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "45bb586a89db40059a027d04c86a420e"
format_stamp: "Formatted at 2026-08-09 02:21:04 on dist-test-slave-jlzn"
server_key: "9f0780826ca6d9c6b86a98288a75f4ad"
server_key_iv: "72ba82d4ce81067e413ef86b6b3e064f"
server_key_version: "encryptionkey@0"
I20260809 02:21:04.619838 7910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:04.630699 7910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:04.633162 7910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:04.633303 7910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:04.633771 7910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:04.634476 7910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:04.634521 7910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.634557 7910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:04.634577 7910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:04.642887 7910 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:36345
I20260809 02:21:04.642910 8102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:36345 every 8 connection(s)
I20260809 02:21:04.643404 7910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:04.653568 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 7910
I20260809 02:21:04.653685 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
Aug 09 02:21:04 dist-test-slave-jlzn krb5kdc[7358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242064, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:04.653968 1351 external_mini_cluster.cc:1428] Setting key b52daaa8468cf3ec9240b202a05fde87
I20260809 02:21:04.657682 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.644912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:58415 (local address 127.1.81.254:45797)
0809 02:21:04.645035 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.645039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.646069 (+ 1030us) server_negotiation.cc:407] Connection header received
0809 02:21:04.646807 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.646810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.646855 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.646922 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:04.647929 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.648453 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.649482 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.649686 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.649751 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.654511 (+ 4760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:04.654515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:04.654518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:04.654544 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:04.656056 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:04.656537 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:04.656540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:04.656541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:04.656616 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:04.656861 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:04.656863 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:04.656864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:04.657023 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:04.657088 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.657462 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.657558 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:04.658418 8106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.645202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:45797 (local address 127.1.81.195:58415)
0809 02:21:04.645935 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.645972 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.646651 (+ 679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.647061 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.647067 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.647373 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:04.647794 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.647831 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.648537 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.648539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.649395 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.649403 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.649785 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.649788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.649920 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.652808 (+ 2888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:04.652824 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:04.654347 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:04.656168 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:04.656173 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:04.656183 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:04.656457 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:04.656678 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:04.656680 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:04.656681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:04.656800 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:04.657089 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:04.657093 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:04.657292 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.657430 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.657645 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":122,"threads_started":1}
I20260809 02:21:04.659363 8103 heartbeater.cc:347] Connected to a master server at 127.1.81.254:45797
I20260809 02:21:04.659567 8103 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:04.659996 8103 heartbeater.cc:511] Master 127.1.81.254:45797 requested a full tablet report, sending...
I20260809 02:21:04.660887 7423 ts_manager.cc:194] Registered new tserver with Master: 45bb586a89db40059a027d04c86a420e (127.1.81.195:36345)
I20260809 02:21:04.661422 7423 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:58415
I20260809 02:21:04.667505 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:21:04.675163 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.669266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49662 (local address 127.1.81.254:45797)
0809 02:21:04.669369 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.669372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.669543 (+ 171us) server_negotiation.cc:407] Connection header received
0809 02:21:04.669629 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.669631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.669671 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.669730 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:04.670306 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.670775 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.671493 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.671702 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.671766 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.672927 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:04.672929 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:04.672931 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:04.672948 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:04.673969 (+ 1021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:04.674303 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:04.674305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:04.674307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:04.674369 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:04.674541 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:04.674543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:04.674544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:04.674733 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:04.674829 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.674974 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.675058 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:21:04.677469 7423 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:04.680325 7423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:04.693320 8130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.688399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36345 (local address 127.0.0.1:35004)
0809 02:21:04.689109 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.689122 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.689213 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.689675 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.689679 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.689698 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:04.689791 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.689797 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.690963 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.690966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.691972 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.691983 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.692823 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.692827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.692936 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.692976 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.693075 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.693186 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":48,"thread_start_us":92,"threads_started":1}
I20260809 02:21:04.693338 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.688400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35004 (local address 127.1.81.195:36345)
0809 02:21:04.688781 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.688836 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.689296 (+ 460us) server_negotiation.cc:407] Connection header received
0809 02:21:04.689367 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.689372 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.689535 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.689686 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:04.689891 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.690837 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.692104 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.692709 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.692805 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.692938 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.693114 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.693210 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":123,"threads_started":1}
I20260809 02:21:04.693596 8117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.687742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:33827 (local address 127.0.0.1:43494)
0809 02:21:04.688219 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.688267 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.688388 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.688951 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.688957 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.688981 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:04.689106 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.689113 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.690507 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.690510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.691965 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.691975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.693214 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.693218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.693313 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.693335 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.693400 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.693463 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":36,"thread_start_us":97,"threads_started":1}
I20260809 02:21:04.694150 8118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.687956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43494 (local address 127.1.81.194:33827)
0809 02:21:04.688286 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.688299 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.688325 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:21:04.688589 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.688596 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.688799 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.688950 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:04.689255 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.690382 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.692104 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.692918 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.693006 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.693149 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.693883 (+ 734us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.693989 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":116,"threads_started":1}
I20260809 02:21:04.694403 8120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.688820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:44755 (local address 127.0.0.1:46664)
0809 02:21:04.689665 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.689677 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.689759 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.690185 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.690188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.690206 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:04.690298 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.690304 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.691722 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.691725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.692883 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.692895 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.694059 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.694061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.694124 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.694140 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.694212 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.694280 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"mutex_wait_us":4,"thread_start_us":89,"threads_started":1}
I20260809 02:21:04.694501 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.688990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46664 (local address 127.1.81.193:44755)
0809 02:21:04.689513 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.689526 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.689856 (+ 330us) server_negotiation.cc:407] Connection header received
0809 02:21:04.689937 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.689940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.690067 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.690198 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:04.690401 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.691570 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.693029 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.693813 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.693908 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.694008 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.694265 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.694357 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":151,"threads_started":1}
I20260809 02:21:04.696540 8008 tablet_service.cc:1467] Processing CreateTablet for tablet 876cda089bd34a20ac8b274e822f76d7 (DEFAULT_TABLE table=test-table [id=001a7e87f2d5407e9a7f2a53647570b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:04.697399 8008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 876cda089bd34a20ac8b274e822f76d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:04.697106 7810 tablet_service.cc:1467] Processing CreateTablet for tablet 876cda089bd34a20ac8b274e822f76d7 (DEFAULT_TABLE table=test-table [id=001a7e87f2d5407e9a7f2a53647570b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:04.698108 7810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 876cda089bd34a20ac8b274e822f76d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:04.697711 7606 tablet_service.cc:1467] Processing CreateTablet for tablet 876cda089bd34a20ac8b274e822f76d7 (DEFAULT_TABLE table=test-table [id=001a7e87f2d5407e9a7f2a53647570b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:04.698659 7606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 876cda089bd34a20ac8b274e822f76d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:04.703238 8132 tablet_bootstrap.cc:492] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: Bootstrap starting.
I20260809 02:21:04.705286 8134 tablet_bootstrap.cc:492] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: Bootstrap starting.
I20260809 02:21:04.705737 8132 tablet_bootstrap.cc:654] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:04.706175 8133 tablet_bootstrap.cc:492] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429: Bootstrap starting.
I20260809 02:21:04.707033 8132 log.cc:824] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:04.707415 8134 tablet_bootstrap.cc:654] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:04.707904 8133 tablet_bootstrap.cc:654] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:04.708665 8134 log.cc:824] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:04.708940 8133 log.cc:824] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:04.709141 8132 tablet_bootstrap.cc:492] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: No bootstrap required, opened a new log
I20260809 02:21:04.709331 8132 ts_tablet_manager.cc:1397] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:21:04.710543 8134 tablet_bootstrap.cc:492] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: No bootstrap required, opened a new log
I20260809 02:21:04.710740 8134 ts_tablet_manager.cc:1397] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:21:04.711408 8133 tablet_bootstrap.cc:492] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429: No bootstrap required, opened a new log
I20260809 02:21:04.711606 8133 ts_tablet_manager.cc:1397] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260809 02:21:04.712756 8132 raft_consensus.cc:348] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.712971 8132 raft_consensus.cc:374] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:04.713052 8132 raft_consensus.cc:729] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45bb586a89db40059a027d04c86a420e, State: Initialized, Role: FOLLOWER
I20260809 02:21:04.713460 8132 consensus_queue.cc:260] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.714042 8103 heartbeater.cc:503] Master 127.1.81.254:45797 was elected leader, sending a full tablet report...
I20260809 02:21:04.714466 8134 raft_consensus.cc:348] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.714731 8134 raft_consensus.cc:374] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:04.714798 8134 raft_consensus.cc:729] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c1801d0e4b4f9e81b677295213d613, State: Initialized, Role: FOLLOWER
I20260809 02:21:04.715230 8134 consensus_queue.cc:260] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.715265 8133 raft_consensus.cc:348] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.715484 8132 ts_tablet_manager.cc:1428] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:21:04.715528 8133 raft_consensus.cc:374] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:04.715637 8133 raft_consensus.cc:729] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 755a8b99d1e6421689430f776eb9f429, State: Initialized, Role: FOLLOWER
I20260809 02:21:04.716125 7905 heartbeater.cc:503] Master 127.1.81.254:45797 was elected leader, sending a full tablet report...
I20260809 02:21:04.716127 8133 consensus_queue.cc:260] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.716249 8134 ts_tablet_manager.cc:1428] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:21:04.716976 8133 ts_tablet_manager.cc:1428] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:21:04.717927 7700 heartbeater.cc:503] Master 127.1.81.254:45797 was elected leader, sending a full tablet report...
W20260809 02:21:04.743820 7701 tablet.cc:2369] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:04.803351 8145 raft_consensus.cc:482] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:04.803520 8145 raft_consensus.cc:504] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.804586 8145 leader_election.cc:288] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c1801d0e4b4f9e81b677295213d613 (127.1.81.194:33827), 45bb586a89db40059a027d04c86a420e (127.1.81.195:36345)
I20260809 02:21:04.807636 8144 raft_consensus.cc:482] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:04.807845 8144 raft_consensus.cc:504] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.808756 8118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.804926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:50687 (local address 127.1.81.194:33827)
0809 02:21:04.805135 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.805140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.805222 (+ 82us) server_negotiation.cc:407] Connection header received
0809 02:21:04.805412 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.805416 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.805472 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.805547 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:04.805883 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.806418 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.807625 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.808156 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.808263 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.808316 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.808561 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.808639 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260809 02:21:04.808763 8148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.804793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:33827 (local address 127.1.81.193:50687)
0809 02:21:04.805115 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.805129 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.805261 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.805570 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.805573 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.805589 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:04.805730 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.805737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.806527 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.806530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.807459 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.807471 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.808274 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.808278 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.808376 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.808453 (+ 77us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.808529 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.808598 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":51,"thread_start_us":100,"threads_started":1}
I20260809 02:21:04.808848 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.804983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:45501 (local address 127.1.81.195:36345)
0809 02:21:04.805146 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.805151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.805248 (+ 97us) server_negotiation.cc:407] Connection header received
0809 02:21:04.805450 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.805453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.805500 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.805544 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:04.805926 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.806432 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.807612 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.808220 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.808327 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.808378 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.808671 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.808744 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 02:21:04.808945 8144 leader_election.cc:288] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45bb586a89db40059a027d04c86a420e (127.1.81.195:36345), 755a8b99d1e6421689430f776eb9f429 (127.1.81.193:44755)
I20260809 02:21:04.809175 8147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.804832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36345 (local address 127.1.81.193:45501)
0809 02:21:04.805169 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.805183 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.805321 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.805683 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.805685 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.805700 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:04.805808 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.805815 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.806532 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.806536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.807461 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.807471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.808385 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.808388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.808529 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.808550 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.808967 (+ 417us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.809042 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":58,"thread_start_us":90,"threads_started":1}
I20260809 02:21:04.809417 7840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "876cda089bd34a20ac8b274e822f76d7" candidate_uuid: "755a8b99d1e6421689430f776eb9f429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c1801d0e4b4f9e81b677295213d613" is_pre_election: true
I20260809 02:21:04.809631 7840 raft_consensus.cc:2454] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 755a8b99d1e6421689430f776eb9f429 in term 0.
I20260809 02:21:04.810113 8035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "876cda089bd34a20ac8b274e822f76d7" candidate_uuid: "755a8b99d1e6421689430f776eb9f429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45bb586a89db40059a027d04c86a420e" is_pre_election: true
I20260809 02:21:04.810220 7533 leader_election.cc:302] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c1801d0e4b4f9e81b677295213d613, 755a8b99d1e6421689430f776eb9f429; no voters:
I20260809 02:21:04.810405 8035 raft_consensus.cc:2454] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 755a8b99d1e6421689430f776eb9f429 in term 0.
I20260809 02:21:04.810505 8145 raft_consensus.cc:2781] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:04.810588 8145 raft_consensus.cc:482] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:04.810643 8145 raft_consensus.cc:3037] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:04.811976 8145 raft_consensus.cc:504] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.812307 8145 leader_election.cc:288] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [CANDIDATE]: Term 1 election: Requested vote from peers 44c1801d0e4b4f9e81b677295213d613 (127.1.81.194:33827), 45bb586a89db40059a027d04c86a420e (127.1.81.195:36345)
I20260809 02:21:04.812614 7840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "876cda089bd34a20ac8b274e822f76d7" candidate_uuid: "755a8b99d1e6421689430f776eb9f429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c1801d0e4b4f9e81b677295213d613"
I20260809 02:21:04.812739 7840 raft_consensus.cc:3037] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:04.813205 8035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "876cda089bd34a20ac8b274e822f76d7" candidate_uuid: "755a8b99d1e6421689430f776eb9f429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45bb586a89db40059a027d04c86a420e"
I20260809 02:21:04.813325 8035 raft_consensus.cc:3037] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:04.813474 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.809220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36345 (local address 127.1.81.194:38649)
0809 02:21:04.809360 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.809373 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.809441 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.810112 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.810115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.810132 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:04.810236 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.810243 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.811255 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.811259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.812330 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.812340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.813073 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.813077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.813191 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.813213 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.813284 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.813352 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":29}
I20260809 02:21:04.813768 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.809583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:38649 (local address 127.1.81.195:36345)
0809 02:21:04.809868 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.809872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.809885 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:04.809920 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.809922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.809959 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.810020 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:04.810363 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.811156 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.812454 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.812970 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.813072 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.813113 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.813608 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.813672 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221}
I20260809 02:21:04.813823 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.809804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:51037 (local address 127.1.81.193:44755)
0809 02:21:04.809972 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.809976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.809988 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:04.810024 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.810027 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.810080 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.810157 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:04.810524 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.811166 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.812679 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.813205 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.813291 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.813332 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.813652 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.813725 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 02:21:04.813997 7840 raft_consensus.cc:2454] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 755a8b99d1e6421689430f776eb9f429 in term 1.
I20260809 02:21:04.814198 8149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.809436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:44755 (local address 127.1.81.194:51037)
0809 02:21:04.809732 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.809744 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:04.809827 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:04.810262 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:04.810265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:04.810283 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:04.810386 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.810392 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.811297 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.811300 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.812536 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:04.812548 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.813423 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.813426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:04.813518 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.813539 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:21:04.813984 (+ 445us) client_negotiation.cc:240] Negotiation successful
0809 02:21:04.814057 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":1,"thread_start_us":114,"threads_started":1}
I20260809 02:21:04.814338 7533 leader_election.cc:302] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c1801d0e4b4f9e81b677295213d613, 755a8b99d1e6421689430f776eb9f429; no voters:
I20260809 02:21:04.814532 8145 raft_consensus.cc:2781] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:04.814566 8035 raft_consensus.cc:2454] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 755a8b99d1e6421689430f776eb9f429 in term 1.
I20260809 02:21:04.814742 8145 raft_consensus.cc:686] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [term 1 LEADER]: Becoming Leader. State: Replica: 755a8b99d1e6421689430f776eb9f429, State: Running, Role: LEADER
I20260809 02:21:04.815078 8035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "876cda089bd34a20ac8b274e822f76d7" candidate_uuid: "44c1801d0e4b4f9e81b677295213d613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45bb586a89db40059a027d04c86a420e" is_pre_election: true
I20260809 02:21:04.815064 8145 consensus_queue.cc:237] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } }
I20260809 02:21:04.815215 8035 raft_consensus.cc:2379] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c1801d0e4b4f9e81b677295213d613 in current term 1: Already voted for candidate 755a8b99d1e6421689430f776eb9f429 in this term.
I20260809 02:21:04.815181 7635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "876cda089bd34a20ac8b274e822f76d7" candidate_uuid: "44c1801d0e4b4f9e81b677295213d613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "755a8b99d1e6421689430f776eb9f429" is_pre_election: true
I20260809 02:21:04.815793 7734 leader_election.cc:302] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c1801d0e4b4f9e81b677295213d613; no voters: 45bb586a89db40059a027d04c86a420e, 755a8b99d1e6421689430f776eb9f429
I20260809 02:21:04.816037 8144 raft_consensus.cc:2726] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 02:21:04.817978 7422 catalog_manager.cc:5495] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 reported cstate change: term changed from 0 to 1, leader changed from <none> to 755a8b99d1e6421689430f776eb9f429 (127.1.81.193). New cstate: current_term: 1 leader_uuid: "755a8b99d1e6421689430f776eb9f429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "755a8b99d1e6421689430f776eb9f429" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44755 } health_report { overall_health: HEALTHY } } }
I20260809 02:21:04.842022 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.839110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46678 (local address 127.1.81.193:44755)
0809 02:21:04.839225 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:04.839229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:04.839241 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:04.839355 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:04.839357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:04.839402 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:04.839480 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:04.839663 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.840176 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.840921 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:04.841118 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:04.841186 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:04.841406 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:04.841768 (+ 362us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:04.841849 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:04.841890 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 02:21:04.841932 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:21:04.847106 8035 raft_consensus.cc:1261] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 1 FOLLOWER]: Refusing update from remote peer 755a8b99d1e6421689430f776eb9f429: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:04.847143 7840 raft_consensus.cc:1261] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 1 FOLLOWER]: Refusing update from remote peer 755a8b99d1e6421689430f776eb9f429: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:04.847702 8145 consensus_queue.cc:1035] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45bb586a89db40059a027d04c86a420e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:04.847899 8150 consensus_queue.cc:1035] T 876cda089bd34a20ac8b274e822f76d7 P 755a8b99d1e6421689430f776eb9f429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c1801d0e4b4f9e81b677295213d613" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:04.855724 8158 mvcc.cc:205] Tried to move back new op lower bound from 7316447497607929856 to 7316447497485295616. Current Snapshot: MvccSnapshot[applied={T|T < 7316447497607929856}]
I20260809 02:21:04.862113 7423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:04.862246 7423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:04.864852 7423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ead0161732742548145b7e91340289d: Sending DeleteTablet for 3 replicas of tablet 876cda089bd34a20ac8b274e822f76d7
I20260809 02:21:04.865715 7810 tablet_service.cc:1514] Processing DeleteTablet for tablet 876cda089bd34a20ac8b274e822f76d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:04 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:43494
I20260809 02:21:04.865747 8008 tablet_service.cc:1514] Processing DeleteTablet for tablet 876cda089bd34a20ac8b274e822f76d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:04 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:35004
I20260809 02:21:04.866334 8179 tablet_replica.cc:330] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: stopping tablet replica
I20260809 02:21:04.866669 8179 raft_consensus.cc:2229] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:04.866993 8179 raft_consensus.cc:2258] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:04.867223 8178 tablet_replica.cc:330] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: stopping tablet replica
I20260809 02:21:04.867525 8178 raft_consensus.cc:2229] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:04.867900 8178 raft_consensus.cc:2258] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:04.868526 8179 ts_tablet_manager.cc:1905] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:04.869719 8178 ts_tablet_manager.cc:1905] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:04.870371 7606 tablet_service.cc:1514] Processing DeleteTablet for tablet 876cda089bd34a20ac8b274e822f76d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:04 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:46664
I20260809 02:21:04.871143 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 7505
I20260809 02:21:04.871599 8179 ts_tablet_manager.cc:1918] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:04.871685 8179 log.cc:1196] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/876cda089bd34a20ac8b274e822f76d7
I20260809 02:21:04.872002 8179 ts_tablet_manager.cc:1939] T 876cda089bd34a20ac8b274e822f76d7 P 44c1801d0e4b4f9e81b677295213d613: Deleting consensus metadata
I20260809 02:21:04.872390 8178 ts_tablet_manager.cc:1918] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:04.872467 8178 log.cc:1196] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/876cda089bd34a20ac8b274e822f76d7
I20260809 02:21:04.872779 8178 ts_tablet_manager.cc:1939] T 876cda089bd34a20ac8b274e822f76d7 P 45bb586a89db40059a027d04c86a420e: Deleting consensus metadata
I20260809 02:21:04.873672 7405 catalog_manager.cc:4841] TS 45bb586a89db40059a027d04c86a420e (127.1.81.195:36345): tablet 876cda089bd34a20ac8b274e822f76d7 (table test-table [id=001a7e87f2d5407e9a7f2a53647570b2]) successfully deleted
I20260809 02:21:04.878297 7401 catalog_manager.cc:4841] TS 44c1801d0e4b4f9e81b677295213d613 (127.1.81.194:33827): tablet 876cda089bd34a20ac8b274e822f76d7 (table test-table [id=001a7e87f2d5407e9a7f2a53647570b2]) successfully deleted
W20260809 02:21:04.884322 7405 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:44755 (error 108)
I20260809 02:21:04.884372 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 7706
I20260809 02:21:04.888792 8120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:04.888498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:44755 (local address 127.0.0.1:46688)
0809 02:21:04.888631 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:04.888707 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:44755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 02:21:04.889113 7405 catalog_manager.cc:4584] TS 755a8b99d1e6421689430f776eb9f429 (127.1.81.193:44755): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 876cda089bd34a20ac8b274e822f76d7: Network error: Client connection negotiation failed: client connection to 127.1.81.193:44755: connect: Connection refused (error 111)
I20260809 02:21:04.894129 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 7910
I20260809 02:21:04.903714 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 7382
2026-08-09T02:21:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2314 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T02:21:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:04Z Disabled control of system clock
I20260809 02:21:04.935236 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34093
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:41899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:34093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:21:05.040405 8186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:05.040622 8186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:05.040663 8186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:05.044504 8186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:05.044552 8186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:05.044567 8186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:05.044597 8186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:05.044622 8186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:05.049160 8186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:34093
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:05.050040 8186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:05.051277 8186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:05.059054 8192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:05.059026 8194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:05.059202 8186 server_base.cc:1034] running on GCE node
W20260809 02:21:05.059018 8196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:05.059778 8186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:05.060770 8186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:05.061920 8186 hybrid_clock.cc:648] HybridClock initialized: now 1786242065061909 us; error 24 us; skew 500 ppm
I20260809 02:21:05.063539 8186 webserver.cc:460] Webserver started at http://127.1.81.254:36985/ using document root <none> and password file <none>
I20260809 02:21:05.064090 8186 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:05.064152 8186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:05.064343 8186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:05.066196 8186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "17abba0f8d3d42b0930df74c48c4ef22"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "1b267d9136bffea2049ca76e8c645486"
server_key_iv: "d9ff1decbe354e88b35ede8f73c615e1"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.066716 8186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "17abba0f8d3d42b0930df74c48c4ef22"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "1b267d9136bffea2049ca76e8c645486"
server_key_iv: "d9ff1decbe354e88b35ede8f73c615e1"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.070221 8186 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260809 02:21:05.072362 8208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.073429 8186 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260809 02:21:05.073539 8186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "17abba0f8d3d42b0930df74c48c4ef22"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "1b267d9136bffea2049ca76e8c645486"
server_key_iv: "d9ff1decbe354e88b35ede8f73c615e1"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.073626 8186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:05.077813 8186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:05.078346 8186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:05.078493 8186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:05.084709 8186 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:34093
I20260809 02:21:05.084720 8286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:34093 every 8 connection(s)
I20260809 02:21:05.085493 8186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:05.088400 8288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:05.090021 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 8186
I20260809 02:21:05.090127 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:05.090369 1351 external_mini_cluster.cc:1428] Setting key 310c57bb1c95d4882eb68d44a64e7eac
I20260809 02:21:05.094102 8288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22: Bootstrap starting.
I20260809 02:21:05.095822 8292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.091630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32878 (local address 127.1.81.254:34093)
0809 02:21:05.092266 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.092285 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.092326 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:21:05.093259 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.093277 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.093587 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.093863 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.094667 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.094672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.094683 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.094693 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.094746 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.094761 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.094863 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.094956 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.095159 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":125,"threads_started":1}
I20260809 02:21:05.096400 8288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:05.097170 8288 log.cc:824] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:05.098835 8288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22: No bootstrap required, opened a new log
I20260809 02:21:05.102150 8288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17abba0f8d3d42b0930df74c48c4ef22" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34093 } }
I20260809 02:21:05.102346 8288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:05.102398 8288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17abba0f8d3d42b0930df74c48c4ef22, State: Initialized, Role: FOLLOWER
I20260809 02:21:05.102762 8288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17abba0f8d3d42b0930df74c48c4ef22" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34093 } }
I20260809 02:21:05.102886 8288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:05.102946 8288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:05.103041 8288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:05.103889 8288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17abba0f8d3d42b0930df74c48c4ef22" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34093 } }
I20260809 02:21:05.104192 8288 leader_election.cc:302] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17abba0f8d3d42b0930df74c48c4ef22; no voters:
I20260809 02:21:05.104476 8288 leader_election.cc:288] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:05.104565 8294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:05.104761 8294 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [term 1 LEADER]: Becoming Leader. State: Replica: 17abba0f8d3d42b0930df74c48c4ef22, State: Running, Role: LEADER
I20260809 02:21:05.105046 8294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17abba0f8d3d42b0930df74c48c4ef22" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34093 } }
I20260809 02:21:05.105525 8288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:05.106514 8301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17abba0f8d3d42b0930df74c48c4ef22. Latest consensus state: current_term: 1 leader_uuid: "17abba0f8d3d42b0930df74c48c4ef22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17abba0f8d3d42b0930df74c48c4ef22" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34093 } } }
I20260809 02:21:05.106642 8301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:05.106904 8296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17abba0f8d3d42b0930df74c48c4ef22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17abba0f8d3d42b0930df74c48c4ef22" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34093 } } }
I20260809 02:21:05.107002 8296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:05.107102 8310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:05.109676 8310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:05.114698 8310 catalog_manager.cc:1347] Generated new cluster ID: 65118d98bfdb4f9b81136deb799a5157
I20260809 02:21:05.114760 8310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:05.137043 8310 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:05.137341 8310 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:05.144210 8310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22: Generated new TSK 0
I20260809 02:21:05.144877 8310 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:21:05.151695 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34093
--builtin_ntp_servers=127.1.81.212:41899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:21:05.260062 8328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:05.260279 8328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:05.260315 8328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:05.264165 8328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:05.264210 8328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:05.264261 8328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:05.268782 8328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:05.269629 8328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:05.270813 8328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:05.279785 8342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:05.279882 8344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:05.279839 8341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:05.280052 8328 server_base.cc:1034] running on GCE node
I20260809 02:21:05.280447 8328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:05.281003 8328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:05.282158 8328 hybrid_clock.cc:648] HybridClock initialized: now 1786242065282142 us; error 35 us; skew 500 ppm
I20260809 02:21:05.283777 8328 webserver.cc:460] Webserver started at http://127.1.81.193:39799/ using document root <none> and password file <none>
I20260809 02:21:05.284320 8328 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:05.284384 8328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:05.284575 8328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:05.286445 8328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "64d6a3eb363f4cd4953fa3f9bb784f31"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "bcb6b25ebac910eaa8aeb468538016ba"
server_key_iv: "bc808f27c27db314e4bfc6ff256c746b"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.286960 8328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "64d6a3eb363f4cd4953fa3f9bb784f31"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "bcb6b25ebac910eaa8aeb468538016ba"
server_key_iv: "bc808f27c27db314e4bfc6ff256c746b"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.290386 8328 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260809 02:21:05.292569 8352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.293655 8328 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:05.293761 8328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "64d6a3eb363f4cd4953fa3f9bb784f31"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "bcb6b25ebac910eaa8aeb468538016ba"
server_key_iv: "bc808f27c27db314e4bfc6ff256c746b"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.293848 8328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:05.298902 8328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:05.299448 8328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:05.299602 8328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:05.300150 8328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:05.300988 8328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:05.301035 8328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.301083 8328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:05.301111 8328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.309487 8328 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:45627
I20260809 02:21:05.309549 8518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:45627 every 8 connection(s)
I20260809 02:21:05.310264 8328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:05.315734 8292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.311858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:35195 (local address 127.1.81.254:34093)
0809 02:21:05.311985 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.311989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.312959 (+ 970us) server_negotiation.cc:407] Connection header received
0809 02:21:05.314210 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.314214 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.314260 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.314335 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.315293 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.315297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.315299 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.315313 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.315333 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.315342 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.315418 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.315545 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.315592 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:21:05.316488 8521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.312201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34093 (local address 127.1.81.193:35195)
0809 02:21:05.312825 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.312862 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:05.313991 (+ 1129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:05.314495 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:05.314501 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:05.314580 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:05.315042 (+ 462us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:05.315043 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:05.315079 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:05.315140 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:05.315411 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:05.315419 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:05.315425 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:21:05.315573 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 02:21:05.315795 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":109,"threads_started":1}
I20260809 02:21:05.317526 8519 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34093
I20260809 02:21:05.317735 8519 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:05.317858 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 8328
I20260809 02:21:05.317981 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:05.318178 8519 heartbeater.cc:511] Master 127.1.81.254:34093 requested a full tablet report, sending...
I20260809 02:21:05.318289 1351 external_mini_cluster.cc:1428] Setting key 969c987490e33ac082849e4279aa3c90
I20260809 02:21:05.319617 8230 ts_manager.cc:194] Registered new tserver with Master: 64d6a3eb363f4cd4953fa3f9bb784f31 (127.1.81.193:45627)
I20260809 02:21:05.320101 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34093
--builtin_ntp_servers=127.1.81.212:41899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:21:05.426308 8522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:05.426523 8522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:05.426575 8522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:05.430445 8522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:05.430490 8522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:05.430562 8522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:05.435073 8522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:05.435968 8522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:05.437184 8522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:05.446103 8530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:05.446170 8531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:05.446185 8533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:05.446219 8522 server_base.cc:1034] running on GCE node
I20260809 02:21:05.446652 8522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:05.447225 8522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:05.448378 8522 hybrid_clock.cc:648] HybridClock initialized: now 1786242065448365 us; error 26 us; skew 500 ppm
I20260809 02:21:05.449977 8522 webserver.cc:460] Webserver started at http://127.1.81.194:34253/ using document root <none> and password file <none>
I20260809 02:21:05.450488 8522 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:05.450554 8522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:05.450752 8522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:05.452672 8522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "6b337397bd0f4442b03dc8b6709b86e4"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "74c82e193ce2751ed7f2d2266b6fb9c5"
server_key_iv: "a96a919a63439f6739f95867a074036f"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.453188 8522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "6b337397bd0f4442b03dc8b6709b86e4"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "74c82e193ce2751ed7f2d2266b6fb9c5"
server_key_iv: "a96a919a63439f6739f95867a074036f"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.456600 8522 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:05.458710 8539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.459774 8522 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:05.459900 8522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "6b337397bd0f4442b03dc8b6709b86e4"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "74c82e193ce2751ed7f2d2266b6fb9c5"
server_key_iv: "a96a919a63439f6739f95867a074036f"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.459985 8522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:05.464076 8522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:05.464581 8522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:05.464708 8522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:05.465167 8522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:05.465999 8522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:05.466044 8522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.466079 8522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:05.466099 8522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.473944 8522 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:33323
I20260809 02:21:05.474009 8703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:33323 every 8 connection(s)
I20260809 02:21:05.474700 8522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:05.475943 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 8522
I20260809 02:21:05.476068 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:05.476393 1351 external_mini_cluster.cc:1428] Setting key 5ee2043316c85f34fdd8f80c414593ef
I20260809 02:21:05.478530 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34093
--builtin_ntp_servers=127.1.81.212:41899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 02:21:05.480767 8292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.476942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:48465 (local address 127.1.81.254:34093)
0809 02:21:05.477059 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.477063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.477844 (+ 781us) server_negotiation.cc:407] Connection header received
0809 02:21:05.479197 (+ 1353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.479200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.479245 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.479327 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.480333 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.480337 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.480339 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.480352 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.480374 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.480383 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.480455 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.480582 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.480625 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 02:21:05.481506 8707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.476865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34093 (local address 127.1.81.194:48465)
0809 02:21:05.477692 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.477763 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:05.478996 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:05.479439 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:05.479444 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:05.479520 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:05.480081 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:05.480083 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:05.480119 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:05.480192 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:05.480452 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:05.480461 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:05.480467 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:21:05.480614 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 02:21:05.480828 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":147,"threads_started":1}
I20260809 02:21:05.482556 8705 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34093
I20260809 02:21:05.482766 8705 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:05.483144 8705 heartbeater.cc:511] Master 127.1.81.254:34093 requested a full tablet report, sending...
I20260809 02:21:05.484134 8230 ts_manager.cc:194] Registered new tserver with Master: 6b337397bd0f4442b03dc8b6709b86e4 (127.1.81.194:33323)
W20260809 02:21:05.585505 8708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:05.585731 8708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:05.585783 8708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:05.589653 8708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:05.589699 8708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:05.589771 8708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:05.594349 8708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:05.595222 8708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:05.596439 8708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:05.605366 8713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:05.605376 8714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:05.605425 8708 server_base.cc:1034] running on GCE node
W20260809 02:21:05.605453 8719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:05.605971 8708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:05.606560 8708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:05.607717 8708 hybrid_clock.cc:648] HybridClock initialized: now 1786242065607695 us; error 31 us; skew 500 ppm
I20260809 02:21:05.609325 8708 webserver.cc:460] Webserver started at http://127.1.81.195:37563/ using document root <none> and password file <none>
I20260809 02:21:05.609833 8708 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:05.609899 8708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:05.610093 8708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:05.612046 8708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "25283f79f68a4e5a941bafd54a4b8d7f"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "071f022c217877866a1f4f4caa88a0d6"
server_key_iv: "d2f68bda39e54093929c2eba78e7f2b0"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.612527 8708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "25283f79f68a4e5a941bafd54a4b8d7f"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "071f022c217877866a1f4f4caa88a0d6"
server_key_iv: "d2f68bda39e54093929c2eba78e7f2b0"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.615733 8708 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:05.617903 8729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.618975 8708 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:05.619071 8708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "25283f79f68a4e5a941bafd54a4b8d7f"
format_stamp: "Formatted at 2026-08-09 02:21:05 on dist-test-slave-jlzn"
server_key: "071f022c217877866a1f4f4caa88a0d6"
server_key_iv: "d2f68bda39e54093929c2eba78e7f2b0"
server_key_version: "encryptionkey@0"
I20260809 02:21:05.619166 8708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:05.623306 8708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:05.623875 8708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:05.624022 8708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:05.624511 8708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:05.625339 8708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:05.625386 8708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.625427 8708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:05.625454 8708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:05.633575 8708 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:44713
I20260809 02:21:05.633597 8904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:44713 every 8 connection(s)
I20260809 02:21:05.634339 8708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:05.634827 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 8708
I20260809 02:21:05.634943 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:05.635231 1351 external_mini_cluster.cc:1428] Setting key 2d3528060b525dac4035656680a28afc
I20260809 02:21:05.640131 8292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.636081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:41795 (local address 127.1.81.254:34093)
0809 02:21:05.636203 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.636208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.637375 (+ 1167us) server_negotiation.cc:407] Connection header received
0809 02:21:05.638631 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.638635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.638678 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.638751 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.639699 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.639702 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.639705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.639717 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.639741 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.639751 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.639840 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.639960 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.640002 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:21:05.640882 8907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.636560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34093 (local address 127.1.81.195:41795)
0809 02:21:05.637242 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.637294 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:05.638444 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:05.638916 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:05.638922 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:05.639004 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:05.639472 (+ 468us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:05.639473 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:05.639508 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:05.639570 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:05.639831 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:05.639840 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:05.639846 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:21:05.639995 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 02:21:05.640212 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":158,"threads_started":1}
I20260809 02:21:05.641820 8905 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34093
I20260809 02:21:05.642011 8905 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:05.642355 8905 heartbeater.cc:511] Master 127.1.81.254:34093 requested a full tablet report, sending...
I20260809 02:21:05.643244 8230 ts_manager.cc:194] Registered new tserver with Master: 25283f79f68a4e5a941bafd54a4b8d7f (127.1.81.195:44713)
I20260809 02:21:05.648924 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:21:05.651933 8292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.650628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32888 (local address 127.1.81.254:34093)
0809 02:21:05.650740 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.650744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.650925 (+ 181us) server_negotiation.cc:407] Connection header received
0809 02:21:05.651009 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.651011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.651037 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.651096 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.651663 (+ 567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.651665 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.651667 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.651674 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.651686 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.651691 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.651740 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.651783 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.651828 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:21:05.654282 8230 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:05.657152 8230 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:05.667415 8929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.664595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:44713 (local address 127.0.0.1:57608)
0809 02:21:05.665439 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.665452 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:05.665530 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:05.666087 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:05.666090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:05.666106 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:05.666765 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:05.666766 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:05.666777 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:05.666804 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:05.667130 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:05.667149 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:05.667155 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:21:05.667257 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:21:05.667307 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":783,"thread_start_us":92,"threads_started":1}
I20260809 02:21:05.667632 8925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.664424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:33323 (local address 127.0.0.1:46480)
0809 02:21:05.664707 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.664756 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:05.664841 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:05.665927 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:05.665933 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:05.665997 (+ 64us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:05.666492 (+ 495us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:05.666494 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:05.666512 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:05.666569 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:05.667177 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:05.667181 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:05.667184 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:21:05.667461 (+ 277us) client_negotiation.cc:240] Negotiation successful
0809 02:21:05.667501 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260809 02:21:05.668129 8931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.665031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.1.81.194:33323)
0809 02:21:05.665481 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.665492 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.665516 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:21:05.665567 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.665572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.665774 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.665909 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.666960 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.666966 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.666980 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.666993 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.667037 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.667073 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.667846 (+ 773us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.667898 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.667973 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":132,"threads_started":1}
I20260809 02:21:05.668349 8926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.664884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:45627 (local address 127.0.0.1:51686)
0809 02:21:05.666570 (+ 1686us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.666584 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:05.666677 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:05.667057 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:05.667060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:05.667074 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:05.667466 (+ 392us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:05.667468 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:05.667579 (+ 111us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:05.667608 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:05.668034 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:05.668037 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:05.668041 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:05.668116 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:21:05.668148 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1627,"thread_start_us":102,"threads_started":1}
I20260809 02:21:05.668594 8935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.665319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51686 (local address 127.1.81.193:45627)
0809 02:21:05.665808 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.665819 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.666688 (+ 869us) server_negotiation.cc:407] Connection header received
0809 02:21:05.666760 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.666765 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.666931 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.667071 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.667741 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.667747 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.667758 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.667771 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.667832 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.667863 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.667950 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.668367 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.668437 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":112,"threads_started":1}
I20260809 02:21:05.668814 8933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.665115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57608 (local address 127.1.81.195:44713)
0809 02:21:05.665737 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.665754 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.665774 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:21:05.665818 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.665823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.665954 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.666076 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.666922 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.666927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.666935 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.666945 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.666979 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.666999 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.667090 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.668578 (+ 1488us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.668656 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":99,"threads_started":1}
I20260809 02:21:05.671206 8611 tablet_service.cc:1467] Processing CreateTablet for tablet 9e979dcd9a4f42069f2b8333430dfda7 (DEFAULT_TABLE table=test-table [id=6c03c36bc19c449d92ab8e6fa5b13534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:05.671451 8803 tablet_service.cc:1467] Processing CreateTablet for tablet 9e979dcd9a4f42069f2b8333430dfda7 (DEFAULT_TABLE table=test-table [id=6c03c36bc19c449d92ab8e6fa5b13534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:05.671451 8430 tablet_service.cc:1467] Processing CreateTablet for tablet 9e979dcd9a4f42069f2b8333430dfda7 (DEFAULT_TABLE table=test-table [id=6c03c36bc19c449d92ab8e6fa5b13534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:05.672317 8611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e979dcd9a4f42069f2b8333430dfda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:05.672489 8803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e979dcd9a4f42069f2b8333430dfda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:05.672489 8430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e979dcd9a4f42069f2b8333430dfda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:05.679147 8939 tablet_bootstrap.cc:492] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: Bootstrap starting.
I20260809 02:21:05.679697 8936 tablet_bootstrap.cc:492] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Bootstrap starting.
I20260809 02:21:05.681205 8939 tablet_bootstrap.cc:654] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:05.681535 8936 tablet_bootstrap.cc:654] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:05.681919 8939 log.cc:824] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:05.682201 8936 log.cc:824] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:05.682492 8938 tablet_bootstrap.cc:492] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31: Bootstrap starting.
I20260809 02:21:05.683740 8939 tablet_bootstrap.cc:492] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: No bootstrap required, opened a new log
I20260809 02:21:05.683956 8939 ts_tablet_manager.cc:1397] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:21:05.684234 8938 tablet_bootstrap.cc:654] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:05.684254 8936 tablet_bootstrap.cc:492] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: No bootstrap required, opened a new log
I20260809 02:21:05.684420 8936 ts_tablet_manager.cc:1397] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:21:05.684885 8938 log.cc:824] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:05.686687 8938 tablet_bootstrap.cc:492] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31: No bootstrap required, opened a new log
I20260809 02:21:05.686856 8938 ts_tablet_manager.cc:1397] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 02:21:05.688310 8939 raft_consensus.cc:348] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.688565 8939 raft_consensus.cc:374] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:05.688613 8939 raft_consensus.cc:729] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25283f79f68a4e5a941bafd54a4b8d7f, State: Initialized, Role: FOLLOWER
I20260809 02:21:05.688678 8936 raft_consensus.cc:348] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.688899 8936 raft_consensus.cc:374] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:05.688951 8936 raft_consensus.cc:729] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b337397bd0f4442b03dc8b6709b86e4, State: Initialized, Role: FOLLOWER
I20260809 02:21:05.689072 8939 consensus_queue.cc:260] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.689355 8936 consensus_queue.cc:260] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.689765 8905 heartbeater.cc:503] Master 127.1.81.254:34093 was elected leader, sending a full tablet report...
I20260809 02:21:05.690306 8936 ts_tablet_manager.cc:1428] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:21:05.690629 8705 heartbeater.cc:503] Master 127.1.81.254:34093 was elected leader, sending a full tablet report...
I20260809 02:21:05.690469 8938 raft_consensus.cc:348] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.690711 8938 raft_consensus.cc:374] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:05.690757 8938 raft_consensus.cc:729] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d6a3eb363f4cd4953fa3f9bb784f31, State: Initialized, Role: FOLLOWER
I20260809 02:21:05.691155 8939 ts_tablet_manager.cc:1428] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 02:21:05.691182 8938 consensus_queue.cc:260] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.692143 8938 ts_tablet_manager.cc:1428] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:21:05.692447 8519 heartbeater.cc:503] Master 127.1.81.254:34093 was elected leader, sending a full tablet report...
W20260809 02:21:05.725507 8706 tablet.cc:2369] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:05.775432 8948 raft_consensus.cc:482] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:05.775607 8948 raft_consensus.cc:504] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.776705 8948 leader_election.cc:288] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b337397bd0f4442b03dc8b6709b86e4 (127.1.81.194:33323), 64d6a3eb363f4cd4953fa3f9bb784f31 (127.1.81.193:45627)
I20260809 02:21:05.778532 8931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.777083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:54129 (local address 127.1.81.194:33323)
0809 02:21:05.777271 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.777275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.777288 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:05.777330 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.777334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.777371 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.777443 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.778168 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.778172 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.778175 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.778186 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.778205 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.778213 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.778291 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.778368 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.778407 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 02:21:05.778541 8907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.776891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:33323 (local address 127.1.81.195:54129)
0809 02:21:05.777006 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.777021 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:05.777105 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:05.777520 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:05.777523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:05.777546 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:05.778000 (+ 454us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:05.778002 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:05.778012 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:05.778038 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:05.778284 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:05.778287 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:05.778289 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:21:05.778369 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:21:05.778405 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 02:21:05.778630 8935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.777068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:53709 (local address 127.1.81.193:45627)
0809 02:21:05.777207 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.777212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.777386 (+ 174us) server_negotiation.cc:407] Connection header received
0809 02:21:05.777484 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.777487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.777527 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.777599 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.778284 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.778288 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.778291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.778303 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.778320 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.778328 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.778401 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.778470 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.778505 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:21:05.778672 8952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.776930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:45627 (local address 127.1.81.195:53709)
0809 02:21:05.777303 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.777316 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:05.777394 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:05.777639 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:05.777641 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:05.777655 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:05.778121 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:05.778122 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:05.778132 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:05.778167 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:05.778396 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:05.778398 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:05.778402 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:05.778471 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:21:05.778505 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":139,"threads_started":1}
I20260809 02:21:05.779198 8638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e979dcd9a4f42069f2b8333430dfda7" candidate_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b337397bd0f4442b03dc8b6709b86e4" is_pre_election: true
I20260809 02:21:05.779290 8458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e979dcd9a4f42069f2b8333430dfda7" candidate_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" is_pre_election: true
I20260809 02:21:05.779469 8638 raft_consensus.cc:2454] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25283f79f68a4e5a941bafd54a4b8d7f in term 0.
I20260809 02:21:05.779564 8458 raft_consensus.cc:2454] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25283f79f68a4e5a941bafd54a4b8d7f in term 0.
I20260809 02:21:05.779927 8731 leader_election.cc:302] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25283f79f68a4e5a941bafd54a4b8d7f, 6b337397bd0f4442b03dc8b6709b86e4; no voters:
I20260809 02:21:05.780196 8948 raft_consensus.cc:2781] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:05.780282 8948 raft_consensus.cc:482] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:05.780330 8948 raft_consensus.cc:3037] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:05.781327 8948 raft_consensus.cc:504] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.781616 8948 leader_election.cc:288] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [CANDIDATE]: Term 1 election: Requested vote from peers 6b337397bd0f4442b03dc8b6709b86e4 (127.1.81.194:33323), 64d6a3eb363f4cd4953fa3f9bb784f31 (127.1.81.193:45627)
I20260809 02:21:05.781957 8458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e979dcd9a4f42069f2b8333430dfda7" candidate_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31"
I20260809 02:21:05.781962 8638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e979dcd9a4f42069f2b8333430dfda7" candidate_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b337397bd0f4442b03dc8b6709b86e4"
I20260809 02:21:05.782065 8458 raft_consensus.cc:3037] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:05.782083 8638 raft_consensus.cc:3037] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:05.783066 8458 raft_consensus.cc:2454] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25283f79f68a4e5a941bafd54a4b8d7f in term 1.
I20260809 02:21:05.783089 8638 raft_consensus.cc:2454] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25283f79f68a4e5a941bafd54a4b8d7f in term 1.
I20260809 02:21:05.783349 8730 leader_election.cc:302] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25283f79f68a4e5a941bafd54a4b8d7f, 64d6a3eb363f4cd4953fa3f9bb784f31; no voters:
I20260809 02:21:05.783509 8948 raft_consensus.cc:2781] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:05.783713 8948 raft_consensus.cc:686] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 1 LEADER]: Becoming Leader. State: Replica: 25283f79f68a4e5a941bafd54a4b8d7f, State: Running, Role: LEADER
I20260809 02:21:05.784036 8948 consensus_queue.cc:237] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } }
I20260809 02:21:05.786888 8230 catalog_manager.cc:5495] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 25283f79f68a4e5a941bafd54a4b8d7f (127.1.81.195). New cstate: current_term: 1 leader_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25283f79f68a4e5a941bafd54a4b8d7f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 44713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 } health_report { overall_health: UNKNOWN } } }
W20260809 02:21:05.811290 8520 tablet.cc:2369] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:05.815624 8933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.814450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57612 (local address 127.1.81.195:44713)
0809 02:21:05.814551 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:05.814554 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:05.814566 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:05.814691 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:05.814694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:05.814744 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:05.814811 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:05.815349 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:05.815352 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:05.815354 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:05.815364 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:05.815382 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:05.815389 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:05.815456 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:05.815501 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 02:21:05.815531 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:21:05.820838 8458 raft_consensus.cc:1261] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [term 1 FOLLOWER]: Refusing update from remote peer 25283f79f68a4e5a941bafd54a4b8d7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:05.820839 8638 raft_consensus.cc:1261] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 1 FOLLOWER]: Refusing update from remote peer 25283f79f68a4e5a941bafd54a4b8d7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:05.821447 8953 consensus_queue.cc:1035] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "64d6a3eb363f4cd4953fa3f9bb784f31" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:05.821633 8948 consensus_queue.cc:1035] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b337397bd0f4442b03dc8b6709b86e4" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:05.828694 8962 mvcc.cc:205] Tried to move back new op lower bound from 7316447501595832320 to 7316447501454012416. Current Snapshot: MvccSnapshot[applied={T|T < 7316447501595832320}]
I20260809 02:21:05.829417 8960 mvcc.cc:205] Tried to move back new op lower bound from 7316447501595832320 to 7316447501454012416. Current Snapshot: MvccSnapshot[applied={T|T < 7316447501595832320 or (T in {7316447501595832320})}]
I20260809 02:21:05.844424 8231 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:05.844609 8231 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:05.847182 8231 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 17abba0f8d3d42b0930df74c48c4ef22: Sending DeleteTablet for 3 replicas of tablet 9e979dcd9a4f42069f2b8333430dfda7
I20260809 02:21:05.848050 8803 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e979dcd9a4f42069f2b8333430dfda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:05 UTC) from {username='slave'} at 127.0.0.1:57608
I20260809 02:21:05.848073 8430 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e979dcd9a4f42069f2b8333430dfda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:05 UTC) from {username='slave'} at 127.0.0.1:51686
I20260809 02:21:05.848524 8611 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e979dcd9a4f42069f2b8333430dfda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:05 UTC) from {username='slave'} at 127.0.0.1:46480
I20260809 02:21:05.848609 8972 tablet_replica.cc:330] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31: stopping tablet replica
I20260809 02:21:05.848999 8972 raft_consensus.cc:2229] T 9e979dcd9a4f42069f2b8333430dfda7 P 64d6a3eb363f4cd4953fa3f9bb784f31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:05.849071 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 8328
I20260809 02:21:05.865080 8974 tablet_replica.cc:330] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: stopping tablet replica
I20260809 02:21:05.865393 8974 raft_consensus.cc:2229] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:05.865676 8974 raft_consensus.cc:2258] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:05.867967 8974 ts_tablet_manager.cc:1905] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:05.870695 8974 ts_tablet_manager.cc:1918] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:05.870784 8974 log.cc:1196] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/9e979dcd9a4f42069f2b8333430dfda7
I20260809 02:21:05.871065 8974 ts_tablet_manager.cc:1939] T 9e979dcd9a4f42069f2b8333430dfda7 P 6b337397bd0f4442b03dc8b6709b86e4: Deleting consensus metadata
I20260809 02:21:05.872499 8211 catalog_manager.cc:4841] TS 6b337397bd0f4442b03dc8b6709b86e4 (127.1.81.194:33323): tablet 9e979dcd9a4f42069f2b8333430dfda7 (table test-table [id=6c03c36bc19c449d92ab8e6fa5b13534]) successfully deleted
I20260809 02:21:05.872730 8971 tablet_replica.cc:330] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: stopping tablet replica
I20260809 02:21:05.873019 8971 raft_consensus.cc:2229] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:05.873358 8971 raft_consensus.cc:2258] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:05.874564 8971 ts_tablet_manager.cc:1905] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:05.877223 8971 ts_tablet_manager.cc:1918] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:05.877322 8971 log.cc:1196] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/9e979dcd9a4f42069f2b8333430dfda7
I20260809 02:21:05.877635 8971 ts_tablet_manager.cc:1939] T 9e979dcd9a4f42069f2b8333430dfda7 P 25283f79f68a4e5a941bafd54a4b8d7f: Deleting consensus metadata
I20260809 02:21:05.878686 8212 catalog_manager.cc:4841] TS 25283f79f68a4e5a941bafd54a4b8d7f (127.1.81.195:44713): tablet 9e979dcd9a4f42069f2b8333430dfda7 (table test-table [id=6c03c36bc19c449d92ab8e6fa5b13534]) successfully deleted
W20260809 02:21:05.880067 8209 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:45627 (error 108)
I20260809 02:21:05.880194 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 8522
I20260809 02:21:05.887745 8926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:05.887453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:45627 (local address 127.0.0.1:51700)
0809 02:21:05.887588 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:05.887667 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:45627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:21:05.887952 8209 catalog_manager.cc:4584] TS 64d6a3eb363f4cd4953fa3f9bb784f31 (127.1.81.193:45627): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9e979dcd9a4f42069f2b8333430dfda7: Network error: Client connection negotiation failed: client connection to 127.1.81.193:45627: connect: Connection refused (error 111)
I20260809 02:21:05.894450 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 8708
I20260809 02:21:05.905997 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 8186
2026-08-09T02:21:05Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1003 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 02:21:05.930876 1351 mini_oidc.cc:152] Starting JWKS server
I20260809 02:21:05.932554 1351 webserver.cc:460] Webserver started at https://127.0.0.1:44061/ using document root <none> and password file <none>
I20260809 02:21:05.932699 1351 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:21:05.932921 1351 webserver.cc:460] Webserver started at http://127.0.0.1:41301/ using document root <none> and password file <none>
2026-08-09T02:21:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:05Z Disabled control of system clock
I20260809 02:21:05.941900 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:46741
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:37647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:46741
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44061/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/testchainca.cert with env {}
W20260809 02:21:06.047547 8983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:06.047770 8983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:06.047838 8983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:06.051719 8983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:06.051767 8983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:06.051782 8983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:06.051828 8983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:06.051856 8983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:21:06.051885 8983 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:21:06.051913 8983 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44061/jwks.json
I20260809 02:21:06.056974 8983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:46741
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:46741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44061/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:06.057837 8983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:06.058739 8983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:06.066514 8991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:06.066505 8993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:06.066504 8989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:06.066758 8983 server_base.cc:1034] running on GCE node
I20260809 02:21:06.067407 8983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:06.068445 8983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:06.069620 8983 hybrid_clock.cc:648] HybridClock initialized: now 1786242066069604 us; error 25 us; skew 500 ppm
I20260809 02:21:06.071316 8983 webserver.cc:460] Webserver started at http://127.1.81.254:44413/ using document root <none> and password file <none>
I20260809 02:21:06.071884 8983 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:06.071954 8983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:06.072144 8983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:06.073980 8983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "7af1648681ae4b0f87c3a75b72932030"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "c4f9a4152b09da16b6d85c9c17d68da6"
server_key_iv: "608b87a8560c6d259976c5eb2996308d"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.074508 8983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "7af1648681ae4b0f87c3a75b72932030"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "c4f9a4152b09da16b6d85c9c17d68da6"
server_key_iv: "608b87a8560c6d259976c5eb2996308d"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.077900 8983 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:21:06.080107 9006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:06.081152 8983 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:06.081256 8983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "7af1648681ae4b0f87c3a75b72932030"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "c4f9a4152b09da16b6d85c9c17d68da6"
server_key_iv: "608b87a8560c6d259976c5eb2996308d"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.081353 8983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:06.108546 8983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:06.109114 8983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:06.109272 8983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:06.115660 8983 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:46741
I20260809 02:21:06.115675 9084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:46741 every 8 connection(s)
I20260809 02:21:06.116514 8983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:06.116886 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 8983
I20260809 02:21:06.117002 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:06.117254 1351 external_mini_cluster.cc:1428] Setting key eed38e3f0123f03c9cf276b63dfca78c
I20260809 02:21:06.119625 9085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:06.124709 9085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030: Bootstrap starting.
I20260809 02:21:06.125629 9088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:06.118561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39516 (local address 127.1.81.254:46741)
0809 02:21:06.119130 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:06.119145 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:06.119178 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:21:06.119848 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:06.119867 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:06.120229 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:06.120516 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:06.120923 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.121837 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.122712 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.123157 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.123309 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.124111 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:06.124116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:06.124127 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:06.124466 (+ 339us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:06.124518 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:06.124538 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:06.124623 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:06.124765 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 02:21:06.124994 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
I20260809 02:21:06.126906 9085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:06.127718 9085 log.cc:824] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:06.128274 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:21:06.129668 9085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030: No bootstrap required, opened a new log
I20260809 02:21:06.132906 9085 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af1648681ae4b0f87c3a75b72932030" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 46741 } }
I20260809 02:21:06.133098 9085 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:06.133150 9085 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7af1648681ae4b0f87c3a75b72932030, State: Initialized, Role: FOLLOWER
I20260809 02:21:06.133464 9085 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af1648681ae4b0f87c3a75b72932030" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 46741 } }
I20260809 02:21:06.133563 9085 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:06.133605 9085 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:06.133678 9085 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:06.134387 9085 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af1648681ae4b0f87c3a75b72932030" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 46741 } }
I20260809 02:21:06.134663 9085 leader_election.cc:302] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7af1648681ae4b0f87c3a75b72932030; no voters:
I20260809 02:21:06.134891 9085 leader_election.cc:288] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:06.135015 9090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:06.135213 9090 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [term 1 LEADER]: Becoming Leader. State: Replica: 7af1648681ae4b0f87c3a75b72932030, State: Running, Role: LEADER
I20260809 02:21:06.135501 9090 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af1648681ae4b0f87c3a75b72932030" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 46741 } }
I20260809 02:21:06.136003 9085 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:06.137176 9093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7af1648681ae4b0f87c3a75b72932030. Latest consensus state: current_term: 1 leader_uuid: "7af1648681ae4b0f87c3a75b72932030" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af1648681ae4b0f87c3a75b72932030" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 46741 } } }
I20260809 02:21:06.137205 9091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7af1648681ae4b0f87c3a75b72932030" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af1648681ae4b0f87c3a75b72932030" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 46741 } } }
I20260809 02:21:06.137305 9093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:06.137305 9091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:06.137668 9103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:06.140573 9103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:06.145984 9103 catalog_manager.cc:1347] Generated new cluster ID: 2e657470e7a94ee788ece3b0e4c44630
I20260809 02:21:06.146044 9103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:06.152669 9103 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:06.153716 9103 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:06.159893 9103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7af1648681ae4b0f87c3a75b72932030: Generated new TSK 0
I20260809 02:21:06.160418 9103 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 02:21:06.189296 9131 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 02:21:06.189430 9131 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 02:21:06.189901 9088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:06.169020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39528 (local address 127.1.81.254:46741)
0809 02:21:06.169128 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:06.169132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:06.169287 (+ 155us) server_negotiation.cc:407] Connection header received
0809 02:21:06.169471 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:06.169473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:06.169515 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:06.169590 (+ 75us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:21:06.169839 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.170312 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.171485 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.171692 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.171756 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.172134 (+ 378us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:21:06.189538 (+ 17404us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44061/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 02:21:06.189769 (+ 231us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39528: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44061/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 02:21:06.189965 9088 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39528: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44061/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 02:21:06.191042 9130 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:06.168897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:46741 (local address 127.0.0.1:39528)
0809 02:21:06.169210 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:06.169224 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:06.169344 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:06.169619 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:06.169622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:06.169630 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:21:06.169751 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:06.169758 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.170419 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.170422 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:06.171384 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:06.171394 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.171781 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.171785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:06.171902 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.171955 (+ 53us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:21:06.189727 (+ 17772us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44061/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 02:21:06.189920 (+ 193us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.81.254:46741: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44061/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":98,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.1.81.254:46741: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44061/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 02:21:06.191598 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 8983
2026-08-09T02:21:06Z chronyd exiting
I20260809 02:21:06.236516 1351 test_util.cc:175] -----------------------------------------------
I20260809 02:21:06.236588 1351 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242040541704-1351-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (307 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 02:21:06.237600 1351 mini_oidc.cc:152] Starting JWKS server
I20260809 02:21:06.238400 1351 webserver.cc:460] Webserver started at https://127.0.0.1:44035/ using document root <none> and password file <none>
I20260809 02:21:06.238490 1351 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:21:06.238751 1351 webserver.cc:460] Webserver started at http://127.0.0.1:42893/ using document root <none> and password file <none>
2026-08-09T02:21:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:06Z Disabled control of system clock
I20260809 02:21:06.247402 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:40303
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:38019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:40303
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44035/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/testchainca.cert with env {}
W20260809 02:21:06.353818 9139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:06.354048 9139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:06.354099 9139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:06.357970 9139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:06.358017 9139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:06.358038 9139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:06.358058 9139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:06.358079 9139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:21:06.358108 9139 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:21:06.358129 9139 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44035/jwks.json
I20260809 02:21:06.363137 9139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:40303
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:40303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44035/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:06.364041 9139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:06.364912 9139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:06.372481 9146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:06.372493 9145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:06.372488 9149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:06.372673 9139 server_base.cc:1034] running on GCE node
I20260809 02:21:06.373306 9139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:06.374258 9139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:06.375414 9139 hybrid_clock.cc:648] HybridClock initialized: now 1786242066375402 us; error 28 us; skew 500 ppm
I20260809 02:21:06.377065 9139 webserver.cc:460] Webserver started at http://127.1.81.254:46343/ using document root <none> and password file <none>
I20260809 02:21:06.377560 9139 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:06.377626 9139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:06.377821 9139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:06.379597 9139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "3f9469ea69294d9ea7d9b69024e3e844"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "07baa35ba9a6b2ff294924c9c2b8544a"
server_key_iv: "8291d464c46bf1b9487c1f30f314b63b"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.380146 9139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "3f9469ea69294d9ea7d9b69024e3e844"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "07baa35ba9a6b2ff294924c9c2b8544a"
server_key_iv: "8291d464c46bf1b9487c1f30f314b63b"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.383394 9139 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:21:06.385586 9161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:06.386674 9139 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:06.386785 9139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "3f9469ea69294d9ea7d9b69024e3e844"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "07baa35ba9a6b2ff294924c9c2b8544a"
server_key_iv: "8291d464c46bf1b9487c1f30f314b63b"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.386873 9139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:06.410406 9139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:06.411010 9139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:06.411175 9139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:06.417778 9139 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:40303
I20260809 02:21:06.417791 9239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:40303 every 8 connection(s)
I20260809 02:21:06.418607 9139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:06.421514 9240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:06.422170 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 9139
I20260809 02:21:06.422276 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:06.422554 1351 external_mini_cluster.cc:1428] Setting key 2d908971838c98d503630ee3e8927e60
I20260809 02:21:06.428361 9240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844: Bootstrap starting.
I20260809 02:21:06.430706 9240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:06.431119 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:06.423681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40648 (local address 127.1.81.254:40303)
0809 02:21:06.424265 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:06.424280 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:06.424314 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:21:06.425000 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:06.425017 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:06.425373 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:06.425630 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:06.425978 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.426902 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.428107 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.428601 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.428723 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.429525 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:06.429529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:06.429540 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:06.429890 (+ 350us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:06.429947 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:06.429965 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:06.430036 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:06.430193 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 02:21:06.430437 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":139,"threads_started":1}
I20260809 02:21:06.431408 9240 log.cc:824] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:06.433329 9240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844: No bootstrap required, opened a new log
I20260809 02:21:06.433619 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:21:06.436568 9240 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9469ea69294d9ea7d9b69024e3e844" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40303 } }
I20260809 02:21:06.436764 9240 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:06.436815 9240 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f9469ea69294d9ea7d9b69024e3e844, State: Initialized, Role: FOLLOWER
I20260809 02:21:06.437182 9240 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9469ea69294d9ea7d9b69024e3e844" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40303 } }
I20260809 02:21:06.437302 9240 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:06.437363 9240 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:06.437454 9240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:06.438220 9240 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9469ea69294d9ea7d9b69024e3e844" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40303 } }
I20260809 02:21:06.438520 9240 leader_election.cc:302] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f9469ea69294d9ea7d9b69024e3e844; no voters:
I20260809 02:21:06.438795 9240 leader_election.cc:288] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:06.438877 9246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:06.439103 9246 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [term 1 LEADER]: Becoming Leader. State: Replica: 3f9469ea69294d9ea7d9b69024e3e844, State: Running, Role: LEADER
I20260809 02:21:06.439388 9246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9469ea69294d9ea7d9b69024e3e844" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40303 } }
I20260809 02:21:06.439914 9240 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:06.440902 9250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f9469ea69294d9ea7d9b69024e3e844. Latest consensus state: current_term: 1 leader_uuid: "3f9469ea69294d9ea7d9b69024e3e844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9469ea69294d9ea7d9b69024e3e844" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40303 } } }
I20260809 02:21:06.441040 9250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:06.441301 9248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f9469ea69294d9ea7d9b69024e3e844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f9469ea69294d9ea7d9b69024e3e844" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40303 } } }
I20260809 02:21:06.441398 9248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:06.441676 9264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:06.444307 9264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:06.448786 9264 catalog_manager.cc:1347] Generated new cluster ID: f4306cfe42de45b5917a0895ed574e3f
I20260809 02:21:06.448848 9264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:06.484239 9264 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:06.485486 9264 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:06.494364 9264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f9469ea69294d9ea7d9b69024e3e844: Generated new TSK 0
I20260809 02:21:06.495077 9264 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 02:21:06.517510 9291 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 02:21:06.517572 9291 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 02:21:06.518206 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:06.503037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40650 (local address 127.1.81.254:40303)
0809 02:21:06.503163 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:06.503167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:06.503306 (+ 139us) server_negotiation.cc:407] Connection header received
0809 02:21:06.503429 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:06.503433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:06.503486 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:06.503589 (+ 103us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:21:06.503771 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.504598 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.505427 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.505774 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.505873 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.506080 (+ 207us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:21:06.517837 (+ 11757us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44035/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 02:21:06.518067 (+ 230us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40650: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44035/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 02:21:06.518245 9289 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:06.502928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:40303 (local address 127.0.0.1:40650)
0809 02:21:06.503232 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:06.503243 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:06.503335 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:06.503590 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:06.503592 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:06.503597 (+ 5us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:21:06.503686 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:06.503691 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.504709 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.504712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:06.505329 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:06.505336 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.505866 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.505868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:06.505924 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.505944 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:21:06.517985 (+ 12041us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44035/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 02:21:06.518111 (+ 126us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.81.254:40303: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44035/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":107,"threads_started":1}
W20260809 02:21:06.518265 9243 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40650: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44035/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260809 02:21:06.518622 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 9139
2026-08-09T02:21:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (327 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 02:21:06.564635 1351 mini_oidc.cc:152] Starting JWKS server
I20260809 02:21:06.565449 1351 webserver.cc:460] Webserver started at https://127.0.0.1:43737/ using document root <none> and password file <none>
I20260809 02:21:06.565541 1351 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:21:06.565794 1351 webserver.cc:460] Webserver started at http://127.0.0.1:43961/ using document root <none> and password file <none>
2026-08-09T02:21:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:06Z Disabled control of system clock
I20260809 02:21:06.575094 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:38015
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:45713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:38015
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43737/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 02:21:06.681895 9299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:06.682117 9299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:06.682152 9299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:06.685964 9299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:06.686013 9299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:06.686028 9299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:06.686041 9299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:06.686060 9299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:21:06.686075 9299 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:21:06.686087 9299 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43737/jwks.json
I20260809 02:21:06.690656 9299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:38015
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:38015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43737/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:06.691485 9299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:06.692766 9299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:06.700439 9313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:06.700474 9311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:06.700474 9318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:06.700831 9299 server_base.cc:1034] running on GCE node
I20260809 02:21:06.701324 9299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:06.702288 9299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:06.703444 9299 hybrid_clock.cc:648] HybridClock initialized: now 1786242066703426 us; error 30 us; skew 500 ppm
I20260809 02:21:06.705190 9299 webserver.cc:460] Webserver started at http://127.1.81.254:35989/ using document root <none> and password file <none>
I20260809 02:21:06.705696 9299 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:06.705760 9299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:06.705950 9299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:06.707891 9299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "e1218b3ac59244fca0c49fef89852031"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "106c829f4218039db6575e3ab5d4aaf6"
server_key_iv: "e95d25e19c45116d3250d1d43dc6885d"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.708405 9299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "e1218b3ac59244fca0c49fef89852031"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "106c829f4218039db6575e3ab5d4aaf6"
server_key_iv: "e95d25e19c45116d3250d1d43dc6885d"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.711726 9299 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:06.714088 9329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:06.715204 9299 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:06.715317 9299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "e1218b3ac59244fca0c49fef89852031"
format_stamp: "Formatted at 2026-08-09 02:21:06 on dist-test-slave-jlzn"
server_key: "106c829f4218039db6575e3ab5d4aaf6"
server_key_iv: "e95d25e19c45116d3250d1d43dc6885d"
server_key_version: "encryptionkey@0"
I20260809 02:21:06.715408 9299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:06.741505 9299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:06.742075 9299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:06.742230 9299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:06.748581 9299 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:38015
I20260809 02:21:06.748589 9399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:38015 every 8 connection(s)
I20260809 02:21:06.749423 9299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:06.750121 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 9299
I20260809 02:21:06.750216 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:06.750465 1351 external_mini_cluster.cc:1428] Setting key 3a46a8b5683229b79c7d74109ffe80dc
I20260809 02:21:06.752709 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:06.758631 9400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031: Bootstrap starting.
I20260809 02:21:06.758980 9404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:06.751650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.1.81.254:38015)
0809 02:21:06.752238 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:06.752253 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:06.752287 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:21:06.752932 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:06.752948 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:06.753318 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:06.753575 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:06.753927 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.754864 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.756045 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.756487 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.756593 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.757403 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:06.757408 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:06.757420 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:06.757770 (+ 350us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:06.757824 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:06.757843 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:06.757913 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:06.758074 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:21:06.758319 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":151,"threads_started":1}
I20260809 02:21:06.760725 9400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:06.761505 9400 log.cc:824] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:06.761649 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:21:06.763291 9400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031: No bootstrap required, opened a new log
I20260809 02:21:06.766475 9400 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1218b3ac59244fca0c49fef89852031" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38015 } }
I20260809 02:21:06.766674 9400 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:06.766775 9400 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1218b3ac59244fca0c49fef89852031, State: Initialized, Role: FOLLOWER
I20260809 02:21:06.767192 9400 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1218b3ac59244fca0c49fef89852031" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38015 } }
I20260809 02:21:06.767316 9400 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:06.767360 9400 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:06.767426 9400 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:06.768203 9400 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1218b3ac59244fca0c49fef89852031" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38015 } }
I20260809 02:21:06.768472 9400 leader_election.cc:302] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1218b3ac59244fca0c49fef89852031; no voters:
I20260809 02:21:06.768692 9400 leader_election.cc:288] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:06.768790 9408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:06.768988 9408 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [term 1 LEADER]: Becoming Leader. State: Replica: e1218b3ac59244fca0c49fef89852031, State: Running, Role: LEADER
I20260809 02:21:06.769300 9408 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1218b3ac59244fca0c49fef89852031" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38015 } }
I20260809 02:21:06.769742 9400 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:06.770753 9409 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1218b3ac59244fca0c49fef89852031" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1218b3ac59244fca0c49fef89852031" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38015 } } }
I20260809 02:21:06.770891 9409 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:06.771224 9410 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1218b3ac59244fca0c49fef89852031. Latest consensus state: current_term: 1 leader_uuid: "e1218b3ac59244fca0c49fef89852031" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1218b3ac59244fca0c49fef89852031" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38015 } } }
I20260809 02:21:06.771363 9410 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:06.771271 9426 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:06.774464 9426 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:06.779853 9426 catalog_manager.cc:1347] Generated new cluster ID: f19820bdae024f278ec819bcbb1f7b94
I20260809 02:21:06.779913 9426 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:06.812906 9426 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:06.813793 9426 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:06.824777 9426 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1218b3ac59244fca0c49fef89852031: Generated new TSK 0
I20260809 02:21:06.825382 9426 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:21:06.837914 9404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:06.833439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57584 (local address 127.1.81.254:38015)
0809 02:21:06.833546 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:06.833550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:06.833778 (+ 228us) server_negotiation.cc:407] Connection header received
0809 02:21:06.833927 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:06.833930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:06.833974 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:06.834062 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:21:06.834292 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.834777 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.835627 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.835908 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.835997 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.836289 (+ 292us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:21:06.837538 (+ 1249us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43737/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 02:21:06.837780 (+ 242us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57584: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43737/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:21:06.837983 9404 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57584: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43737/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 02:21:06.840864 9445 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:06.833402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38015 (local address 127.0.0.1:57584)
0809 02:21:06.833693 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:06.833704 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:06.833810 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:06.834072 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:06.834075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:06.834083 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:21:06.834195 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:06.834200 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.834901 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.834905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:06.835516 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:06.835523 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:06.836016 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:06.836020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:06.836109 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:06.836132 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:21:06.838170 (+ 2038us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43737/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 02:21:06.840727 (+ 2557us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.81.254:38015: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43737/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":2390,"thread_start_us":96,"threads_started":1}
I20260809 02:21:06.841238 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 9299
E20260809 02:21:06.855443 9446 webserver.cc:533] Webserver: sslize failed:
E20260809 02:21:06.855511 9446 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T02:21:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (323 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T02:21:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:06Z Disabled control of system clock
I20260809 02:21:06.896533 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41917
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:40307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:41917
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/testchainca.cert with env {}
W20260809 02:21:07.001797 9454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:07.002022 9454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:07.002058 9454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:07.005905 9454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:07.005956 9454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:07.005970 9454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:07.005985 9454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:07.006006 9454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:21:07.006019 9454 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:21:07.006036 9454 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 02:21:07.011018 9454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:41917
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:07.011930 9454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:07.012810 9454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:07.020743 9463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:07.020783 9464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:07.020910 9454 server_base.cc:1034] running on GCE node
W20260809 02:21:07.020704 9466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:07.021519 9454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:07.022503 9454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:07.023669 9454 hybrid_clock.cc:648] HybridClock initialized: now 1786242067023655 us; error 33 us; skew 500 ppm
I20260809 02:21:07.025328 9454 webserver.cc:460] Webserver started at http://127.1.81.254:45447/ using document root <none> and password file <none>
I20260809 02:21:07.025840 9454 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:07.025907 9454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:07.026103 9454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:07.027998 9454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "fcea49d0ee9a45b19461e5cce43b14fc"
format_stamp: "Formatted at 2026-08-09 02:21:07 on dist-test-slave-jlzn"
server_key: "deff26cf8338322ec27ac6be2156b494"
server_key_iv: "c8ed0cbef04cace94748ae1c93ee8a07"
server_key_version: "encryptionkey@0"
I20260809 02:21:07.028519 9454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "fcea49d0ee9a45b19461e5cce43b14fc"
format_stamp: "Formatted at 2026-08-09 02:21:07 on dist-test-slave-jlzn"
server_key: "deff26cf8338322ec27ac6be2156b494"
server_key_iv: "c8ed0cbef04cace94748ae1c93ee8a07"
server_key_version: "encryptionkey@0"
I20260809 02:21:07.031881 9454 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:07.034088 9475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:07.035153 9454 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:07.035264 9454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "fcea49d0ee9a45b19461e5cce43b14fc"
format_stamp: "Formatted at 2026-08-09 02:21:07 on dist-test-slave-jlzn"
server_key: "deff26cf8338322ec27ac6be2156b494"
server_key_iv: "c8ed0cbef04cace94748ae1c93ee8a07"
server_key_version: "encryptionkey@0"
I20260809 02:21:07.035353 9454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:07.052834 9454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:07.053448 9454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:07.053615 9454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:07.060115 9454 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:41917
I20260809 02:21:07.060122 9548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:41917 every 8 connection(s)
I20260809 02:21:07.060989 9454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:07.061165 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 9454
I20260809 02:21:07.061269 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:07.061554 1351 external_mini_cluster.cc:1428] Setting key f4d50ce5a9121804e850ec940b7c9ebe
I20260809 02:21:07.064740 9550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:07.070063 9555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:07.062717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48894 (local address 127.1.81.254:41917)
0809 02:21:07.063291 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:07.063309 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:07.063344 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:21:07.064019 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:07.064037 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:07.064418 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:07.064733 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:07.065134 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:07.066078 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:07.066933 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:07.067413 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:07.067558 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:07.068448 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:07.068452 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:07.068464 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:07.068831 (+ 367us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:07.068889 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:07.068908 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:07.068996 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:07.069157 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:21:07.069405 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":108,"threads_started":1}
I20260809 02:21:07.070286 9550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc: Bootstrap starting.
I20260809 02:21:07.072597 9550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:07.072842 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:21:07.073375 9550 log.cc:824] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:07.075297 9550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc: No bootstrap required, opened a new log
I20260809 02:21:07.078696 9550 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcea49d0ee9a45b19461e5cce43b14fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41917 } }
I20260809 02:21:07.078984 9550 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:07.079041 9550 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcea49d0ee9a45b19461e5cce43b14fc, State: Initialized, Role: FOLLOWER
I20260809 02:21:07.079421 9550 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcea49d0ee9a45b19461e5cce43b14fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41917 } }
I20260809 02:21:07.079546 9550 raft_consensus.cc:388] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:07.079610 9550 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:07.079707 9550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:07.080704 9550 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcea49d0ee9a45b19461e5cce43b14fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41917 } }
I20260809 02:21:07.081009 9550 leader_election.cc:302] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcea49d0ee9a45b19461e5cce43b14fc; no voters:
I20260809 02:21:07.081296 9550 leader_election.cc:288] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:07.081393 9560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:07.081607 9560 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [term 1 LEADER]: Becoming Leader. State: Replica: fcea49d0ee9a45b19461e5cce43b14fc, State: Running, Role: LEADER
I20260809 02:21:07.081955 9560 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcea49d0ee9a45b19461e5cce43b14fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41917 } }
I20260809 02:21:07.082404 9550 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:07.083565 9563 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcea49d0ee9a45b19461e5cce43b14fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcea49d0ee9a45b19461e5cce43b14fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41917 } } }
I20260809 02:21:07.083607 9565 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcea49d0ee9a45b19461e5cce43b14fc. Latest consensus state: current_term: 1 leader_uuid: "fcea49d0ee9a45b19461e5cce43b14fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcea49d0ee9a45b19461e5cce43b14fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41917 } } }
I20260809 02:21:07.083714 9563 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:07.083719 9565 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:07.084142 9573 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:07.086898 9573 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:07.092885 9573 catalog_manager.cc:1347] Generated new cluster ID: 1098c7a98b2c42508968666aaca5729d
I20260809 02:21:07.093120 9573 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:07.105669 9573 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:07.106859 9573 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:07.121917 9573 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fcea49d0ee9a45b19461e5cce43b14fc: Generated new TSK 0
I20260809 02:21:07.122543 9573 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:21:07.142230 9555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:07.132450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48896 (local address 127.1.81.254:41917)
0809 02:21:07.132577 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:07.132582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:07.132761 (+ 179us) server_negotiation.cc:407] Connection header received
0809 02:21:07.132911 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:07.132914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:07.132959 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:07.133041 (+ 82us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:21:07.133282 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:07.133781 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:07.134954 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:07.135155 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:07.135218 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:07.135508 (+ 290us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:21:07.141935 (+ 6427us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 02:21:07.142122 (+ 187us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48896: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 02:21:07.142284 9555 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48896: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 02:21:07.142678 9594 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:07.132355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41917 (local address 127.0.0.1:48896)
0809 02:21:07.132679 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:07.132694 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:07.132805 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:07.133060 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:07.133063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:07.133070 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:21:07.133195 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:07.133201 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:07.133878 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:07.133882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:07.134857 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:07.134867 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:07.135250 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:07.135254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:07.135350 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:07.135377 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:21:07.142093 (+ 6716us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 02:21:07.142250 (+ 157us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.81.254:41917: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":88,"threads_started":1}
I20260809 02:21:07.143246 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 9454
2026-08-09T02:21:07Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (279 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (120 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (125 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:07 dist-test-slave-jlzn krb5kdc[9611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:07 dist-test-slave-jlzn krb5kdc[9611](info): set up 2 sockets
Aug 09 02:21:07 dist-test-slave-jlzn krb5kdc[9611](info): commencing operation
krb5kdc: starting...
W20260809 02:21:08.517777 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:08 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:21:08.627647 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:38181
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:38825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:38181
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:08.733840 9628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:08.734063 9628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:08.734119 9628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:08.737975 9628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:08.738024 9628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:08.738051 9628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:08.738072 9628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:08.738096 9628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:08.743002 9628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:38181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:38181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:08.743894 9628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:08.744776 9628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:08.752609 9635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:08.752606 9639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:08.752630 9633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:08.752801 9628 server_base.cc:1034] running on GCE node
I20260809 02:21:08.753448 9628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:08.754405 9628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:08.755558 9628 hybrid_clock.cc:648] HybridClock initialized: now 1786242068755537 us; error 31 us; skew 500 ppm
Aug 09 02:21:08 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242068, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:08.758114 9628 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:21:08.758895 9628 webserver.cc:460] Webserver started at http://127.1.81.254:45785/ using document root <none> and password file <none>
I20260809 02:21:08.759366 9628 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:08.759423 9628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:08.759578 9628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:08.761890 9628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "82ab6fbd2603445b876679ca049e49dc"
format_stamp: "Formatted at 2026-08-09 02:21:08 on dist-test-slave-jlzn"
server_key: "a120fedc81bea8840a317a7f1e11696c"
server_key_iv: "63ed52f047891b252bacfc0cdc9d72e3"
server_key_version: "encryptionkey@0"
I20260809 02:21:08.762387 9628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "82ab6fbd2603445b876679ca049e49dc"
format_stamp: "Formatted at 2026-08-09 02:21:08 on dist-test-slave-jlzn"
server_key: "a120fedc81bea8840a317a7f1e11696c"
server_key_iv: "63ed52f047891b252bacfc0cdc9d72e3"
server_key_version: "encryptionkey@0"
I20260809 02:21:08.765765 9628 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:21:08.767956 9651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:08.769042 9628 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:08.769157 9628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "82ab6fbd2603445b876679ca049e49dc"
format_stamp: "Formatted at 2026-08-09 02:21:08 on dist-test-slave-jlzn"
server_key: "a120fedc81bea8840a317a7f1e11696c"
server_key_iv: "63ed52f047891b252bacfc0cdc9d72e3"
server_key_version: "encryptionkey@0"
I20260809 02:21:08.769249 9628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:08.780341 9628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:08.782626 9628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:08.782790 9628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:08.789283 9628 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:38181
I20260809 02:21:08.789300 9730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:38181 every 8 connection(s)
I20260809 02:21:08.790089 9628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:08.792384 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 9628
I20260809 02:21:08.792500 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:08.792735 9731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:08.792817 1351 external_mini_cluster.cc:1428] Setting key 8b0ad4f6ab9482ae201b5055343b4346
I20260809 02:21:08.799170 9731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc: Bootstrap starting.
Aug 09 02:21:08 dist-test-slave-jlzn krb5kdc[9611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:08.801290 9731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:08.801961 9731 log.cc:824] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:08.803735 9731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc: No bootstrap required, opened a new log
I20260809 02:21:08.805819 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:08.794099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54522 (local address 127.1.81.254:38181)
0809 02:21:08.794486 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:08.794501 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:08.794534 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:21:08.795280 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:08.795297 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:08.795589 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:08.795883 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:08.796739 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:08.797675 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:08.798789 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:08.799224 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:08.799372 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:08.801717 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:08.801722 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:08.801733 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:08.801759 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:08.803282 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:08.803693 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:08.803698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:08.803702 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:08.803849 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:08.804109 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:08.804112 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:08.804113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:08.804468 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:08.804662 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:08.804920 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 02:21:08.805180 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":112,"threads_started":1}
I20260809 02:21:08.807150 9731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ab6fbd2603445b876679ca049e49dc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38181 } }
I20260809 02:21:08.807395 9731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:08.807453 9731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82ab6fbd2603445b876679ca049e49dc, State: Initialized, Role: FOLLOWER
I20260809 02:21:08.807886 9731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ab6fbd2603445b876679ca049e49dc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38181 } }
I20260809 02:21:08.808020 9731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:08.808066 9731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:08.808133 9731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:08.808861 9731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ab6fbd2603445b876679ca049e49dc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38181 } }
I20260809 02:21:08.809129 9731 leader_election.cc:302] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82ab6fbd2603445b876679ca049e49dc; no voters:
I20260809 02:21:08.809355 9731 leader_election.cc:288] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:08.809494 9739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:08.809689 9739 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [term 1 LEADER]: Becoming Leader. State: Replica: 82ab6fbd2603445b876679ca049e49dc, State: Running, Role: LEADER
I20260809 02:21:08.809975 9739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ab6fbd2603445b876679ca049e49dc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38181 } }
I20260809 02:21:08.810405 9731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:08.811618 9742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82ab6fbd2603445b876679ca049e49dc. Latest consensus state: current_term: 1 leader_uuid: "82ab6fbd2603445b876679ca049e49dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ab6fbd2603445b876679ca049e49dc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38181 } } }
I20260809 02:21:08.811795 9742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:08.812142 9741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82ab6fbd2603445b876679ca049e49dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82ab6fbd2603445b876679ca049e49dc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 38181 } } }
I20260809 02:21:08.812294 9741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc [sys.catalog]: This master's current role is: LEADER
W20260809 02:21:08.814790 9772 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:21:08.814855 9772 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:21:08.814931 9762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:08.815727 9762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:08.820286 9762 catalog_manager.cc:1347] Generated new cluster ID: 6346785bfcd34b47af616e556b665a66
I20260809 02:21:08.820348 9762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:08.839164 9762 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:08.840353 9762 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:08.846632 9762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82ab6fbd2603445b876679ca049e49dc: Generated new TSK 0
I20260809 02:21:08.847271 9762 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:21:08.880720 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38181
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:38825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:08.988466 9778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:08.988700 9778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:08.988758 9778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:08.992614 9778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:08.992662 9778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:08.992736 9778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:08.997714 9778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:08.998570 9778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:08.999449 9778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:09.008311 9787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:09.008337 9790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:09.008472 9778 server_base.cc:1034] running on GCE node
W20260809 02:21:09.008347 9792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:09.008899 9778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:09.009457 9778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:09.010609 9778 hybrid_clock.cc:648] HybridClock initialized: now 1786242069010591 us; error 29 us; skew 500 ppm
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.013303 9778 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:21:09.014114 9778 webserver.cc:460] Webserver started at http://127.1.81.193:41111/ using document root <none> and password file <none>
I20260809 02:21:09.014593 9778 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:09.014667 9778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:09.014927 9778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:09.016804 9778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "638b088420ff494087cf36809eecdb1d"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "4dfd6f73fc2104ac269a31f463a77dee"
server_key_iv: "9b2c0782aa4e6cca9e21451c5fc49e97"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.017314 9778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "638b088420ff494087cf36809eecdb1d"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "4dfd6f73fc2104ac269a31f463a77dee"
server_key_iv: "9b2c0782aa4e6cca9e21451c5fc49e97"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.020606 9778 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:21:09.022738 9804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.023784 9778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:09.023918 9778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "638b088420ff494087cf36809eecdb1d"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "4dfd6f73fc2104ac269a31f463a77dee"
server_key_iv: "9b2c0782aa4e6cca9e21451c5fc49e97"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.024005 9778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:09.048436 9778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:09.050851 9778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:09.051003 9778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:09.051509 9778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:09.052296 9778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:09.052345 9778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.052392 9778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:09.052418 9778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.060550 9778 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:34963
I20260809 02:21:09.060582 9969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:34963 every 8 connection(s)
I20260809 02:21:09.061293 9778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:09.066438 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 9778
I20260809 02:21:09.066576 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:09.066849 1351 external_mini_cluster.cc:1428] Setting key 67d74559d60b2e860cb01bde498d57c4
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:09.074728 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.062877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:53365 (local address 127.1.81.254:38181)
0809 02:21:09.063012 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.063017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.063764 (+ 747us) server_negotiation.cc:407] Connection header received
0809 02:21:09.065051 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.065054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.065101 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.065174 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.066162 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.066905 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.068182 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.068455 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.068539 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.071146 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:09.071150 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:09.071152 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:09.071180 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:09.072722 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.073257 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.073260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.073262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.073359 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.073676 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.073679 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.073680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.073901 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:09.074000 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:09.074419 (+ 419us) server_negotiation.cc:299] Negotiation successful
0809 02:21:09.074546 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:21:09.075338 9973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.063208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38181 (local address 127.1.81.193:53365)
0809 02:21:09.063616 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:09.063664 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:09.064868 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:09.065295 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:09.065300 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:09.065615 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:09.066041 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:09.066053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.067023 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.067026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:09.068069 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:09.068081 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.068614 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.068618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:09.068806 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.069368 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:09.069387 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:09.070987 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:09.072827 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:09.072832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:09.072842 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:09.073143 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:09.073456 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:09.073460 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:09.073461 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:09.073591 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:09.073987 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:09.073992 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:09.074202 (+ 210us) client_negotiation.cc:769] Sending connection context
0809 02:21:09.074339 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 02:21:09.074561 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":109,"threads_started":1}
I20260809 02:21:09.076424 9970 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38181
I20260809 02:21:09.076627 9970 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:09.077054 9970 heartbeater.cc:511] Master 127.1.81.254:38181 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:21:09.078446 9677 ts_manager.cc:194] Registered new tserver with Master: 638b088420ff494087cf36809eecdb1d (127.1.81.193:34963)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
I20260809 02:21:09.079550 9677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:53365
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:21:09.092020 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38181
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:38825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:09.197963 9977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:09.198201 9977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:09.198258 9977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:09.202162 9977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:09.202216 9977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:09.202291 9977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:09.207203 9977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:09.208153 9977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:09.209086 9977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:09.218356 9987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:09.218369 9985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:09.218369 9990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:09.218433 9977 server_base.cc:1034] running on GCE node
I20260809 02:21:09.219080 9977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:09.219645 9977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:09.220806 9977 hybrid_clock.cc:648] HybridClock initialized: now 1786242069220797 us; error 40 us; skew 500 ppm
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.223346 9977 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:21:09.224174 9977 webserver.cc:460] Webserver started at http://127.1.81.194:45735/ using document root <none> and password file <none>
I20260809 02:21:09.224663 9977 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:09.224730 9977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:09.224982 9977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:09.226838 9977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "c06c2b9982dd499f94a66bc8002952a4"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "a4caf5f6d1533192742fca054a5271ed"
server_key_iv: "a11c042557034ee930b0916e3dd599cd"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.227444 9977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "c06c2b9982dd499f94a66bc8002952a4"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "a4caf5f6d1533192742fca054a5271ed"
server_key_iv: "a11c042557034ee930b0916e3dd599cd"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.230792 9977 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:21:09.233083 10004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.234140 9977 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:09.234249 9977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "c06c2b9982dd499f94a66bc8002952a4"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "a4caf5f6d1533192742fca054a5271ed"
server_key_iv: "a11c042557034ee930b0916e3dd599cd"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.234335 9977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:09.259492 9977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:09.262395 9977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:09.262562 9977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:09.263098 9977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:09.263890 9977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:09.263937 9977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.263988 9977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:09.264016 9977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.272464 9977 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:35279
I20260809 02:21:09.272640 10190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:35279 every 8 connection(s)
I20260809 02:21:09.273685 9977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:09.277130 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 9977
I20260809 02:21:09.277241 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:09.277515 1351 external_mini_cluster.cc:1428] Setting key 8ee0dfdcfb791bb85e05e02f60785bc7
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:09.288734 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.275454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:53959 (local address 127.1.81.254:38181)
0809 02:21:09.275597 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.275602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.277864 (+ 2262us) server_negotiation.cc:407] Connection header received
0809 02:21:09.279345 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.279348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.279402 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.279472 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.280624 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.281158 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.282267 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.282499 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.282587 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.285244 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:09.285247 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:09.285249 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:09.285272 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:09.286540 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.287135 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.287137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.287146 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.287216 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.287579 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.287581 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.287582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.287752 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:09.287859 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:09.288484 (+ 625us) server_negotiation.cc:299] Negotiation successful
0809 02:21:09.288600 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
I20260809 02:21:09.289860 10195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.275873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38181 (local address 127.1.81.194:53959)
0809 02:21:09.277727 (+ 1854us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:09.277769 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:09.279146 (+ 1377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:09.279630 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:09.279636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:09.280024 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:09.280480 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:09.280493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.281276 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.281279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:09.282151 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:09.282160 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.282636 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.282648 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:09.282800 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.283324 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:09.283339 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:09.285064 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:09.286663 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:09.286669 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:09.286686 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:09.287038 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:09.287298 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:09.287302 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:09.287304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:09.287493 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:09.287866 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:09.287873 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:09.288223 (+ 350us) client_negotiation.cc:769] Sending connection context
0809 02:21:09.288451 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 02:21:09.288811 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1647,"thread_start_us":142,"threads_started":1}
I20260809 02:21:09.290971 10193 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38181
I20260809 02:21:09.291205 10193 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:09.291740 10193 heartbeater.cc:511] Master 127.1.81.254:38181 requested a full tablet report, sending...
I20260809 02:21:09.292769 9677 ts_manager.cc:194] Registered new tserver with Master: c06c2b9982dd499f94a66bc8002952a4 (127.1.81.194:35279)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
I20260809 02:21:09.293476 9677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:53959
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:21:09.307767 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38181
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:38825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:09.416975 10198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:09.417203 10198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:09.417248 10198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:09.421139 10198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:09.421187 10198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:09.421254 10198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:09.426206 10198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:38181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:09.427127 10198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:09.428169 10198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:09.437222 10210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:09.437274 10198 server_base.cc:1034] running on GCE node
W20260809 02:21:09.437237 10207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:09.437245 10206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:09.437883 10198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:09.438426 10198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:09.439589 10198 hybrid_clock.cc:648] HybridClock initialized: now 1786242069439560 us; error 40 us; skew 500 ppm
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.442199 10198 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:21:09.442924 10198 webserver.cc:460] Webserver started at http://127.1.81.195:41501/ using document root <none> and password file <none>
I20260809 02:21:09.443393 10198 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:09.443447 10198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:09.443601 10198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:09.445493 10198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "c4d0bd46dd0a4a1daf9224a28f7bc761"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "db490e459e1c14ebf40024ce6023201b"
server_key_iv: "3ab6b2f7c2bf2ba253454d21a211c221"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.445971 10198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "c4d0bd46dd0a4a1daf9224a28f7bc761"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "db490e459e1c14ebf40024ce6023201b"
server_key_iv: "3ab6b2f7c2bf2ba253454d21a211c221"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.449370 10198 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:21:09.451473 10220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.452584 10198 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:09.452688 10198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "c4d0bd46dd0a4a1daf9224a28f7bc761"
format_stamp: "Formatted at 2026-08-09 02:21:09 on dist-test-slave-jlzn"
server_key: "db490e459e1c14ebf40024ce6023201b"
server_key_iv: "3ab6b2f7c2bf2ba253454d21a211c221"
server_key_version: "encryptionkey@0"
I20260809 02:21:09.452778 10198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:09.461731 10198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:09.464111 10198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:09.464274 10198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:09.464774 10198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:09.465504 10198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:09.465550 10198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.465598 10198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:09.465627 10198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:09.474227 10198 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:37687
I20260809 02:21:09.474267 10378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:37687 every 8 connection(s)
I20260809 02:21:09.475006 10198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:09.483846 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 10198
I20260809 02:21:09.483965 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:09.484313 1351 external_mini_cluster.cc:1428] Setting key f163246fb4363ec1de2a0ee44a090a31
I20260809 02:21:09.487267 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.476626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:36303 (local address 127.1.81.254:38181)
0809 02:21:09.476799 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.476804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.477538 (+ 734us) server_negotiation.cc:407] Connection header received
0809 02:21:09.478802 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.478805 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.478853 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.478921 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.479960 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.480481 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.481525 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.481740 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.481812 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.484034 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:09.484038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:09.484041 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:09.484071 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:09.485470 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.486004 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.486007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.486008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.486081 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.486427 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.486430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.486431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.486603 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:09.486684 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:09.487063 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 02:21:09.487150 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 02:21:09.487987 10383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.476960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:38181 (local address 127.1.81.195:36303)
0809 02:21:09.477390 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:09.477430 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:09.478620 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:09.479056 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:09.479062 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:09.479390 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:09.479849 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:09.479863 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.480569 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.480572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:09.481431 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:09.481440 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.481876 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.481889 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:09.482024 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.482491 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:09.482506 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:09.483875 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:09.485569 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:09.485574 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:09.485588 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:09.485919 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:09.486168 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:09.486171 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:09.486173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:09.486351 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:09.486689 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:09.486693 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:09.486894 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 02:21:09.487031 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 02:21:09.487250 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":126,"threads_started":1}
I20260809 02:21:09.488910 10379 heartbeater.cc:347] Connected to a master server at 127.1.81.254:38181
I20260809 02:21:09.489116 10379 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:09.489545 10379 heartbeater.cc:511] Master 127.1.81.254:38181 requested a full tablet report, sending...
I20260809 02:21:09.490408 9677 ts_manager.cc:194] Registered new tserver with Master: c4d0bd46dd0a4a1daf9224a28f7bc761 (127.1.81.195:37687)
I20260809 02:21:09.490914 9677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:36303
I20260809 02:21:09.497717 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/test-admin.keytab.
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.512732 1351 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 02:21:09.515172 10391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:09.513854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47302 (local address 127.1.81.193:34963)
0809 02:21:09.514173 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.514183 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.514202 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:21:09.514244 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.514249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.514391 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.514507 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.514998 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47302: BlockingRecv error: recv got EOF from 127.0.0.1:47302 (error 108)
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":99,"threads_started":1}
W20260809 02:21:09.515252 1351 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5cc' of type FILE
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.516194 1351 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.517025 1351 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:21:09.525247 10391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.517771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47310 (local address 127.1.81.193:34963)
0809 02:21:09.517895 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.517898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.517947 (+ 49us) server_negotiation.cc:407] Connection header received
0809 02:21:09.518047 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.518049 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.518086 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.518139 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.518564 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.519309 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.520099 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.520440 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.520514 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.522447 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:09.522455 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:09.522465 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:09.522488 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:09.523759 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.524183 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.524187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.524188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.524267 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.524479 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.524482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.524484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.524724 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:09.524872 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:09.525008 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 02:21:09.525127 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 02:21:09.528568 10391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:09.527673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47320 (local address 127.1.81.193:34963)
0809 02:21:09.527780 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.527784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.527906 (+ 122us) server_negotiation.cc:407] Connection header received
0809 02:21:09.528005 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.528009 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.528045 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.528105 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.528489 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47320: BlockingRecv error: recv got EOF from 127.0.0.1:47320 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:21:09.528703 1351 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5cc' of type FILE
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.529553 1351 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.530287 1351 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:21:09.537504 10391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.530969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47330 (local address 127.1.81.193:34963)
0809 02:21:09.531073 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.531077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.531167 (+ 90us) server_negotiation.cc:407] Connection header received
0809 02:21:09.531247 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.531250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.531280 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.531338 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.531751 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.532323 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.533037 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.533252 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.533315 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.535097 (+ 1782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:09.535100 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:09.535102 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:09.535123 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:09.536259 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.536590 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.536592 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.536593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.536658 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.536869 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.536872 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.536874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.537020 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:09.537132 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:09.537285 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 02:21:09.537369 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 02:21:09.539745 10391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:09.538915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47340 (local address 127.1.81.193:34963)
0809 02:21:09.539026 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.539029 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.539099 (+ 70us) server_negotiation.cc:407] Connection header received
0809 02:21:09.539214 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.539217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.539253 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.539308 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.539662 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47340: BlockingRecv error: recv got EOF from 127.0.0.1:47340 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 02:21:09.539875 1351 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242040541704-1351-0/krb5kdc/krb5cc' of type FILE
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.540692 1351 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:09.541406 1351 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[9611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:21:09.548141 10391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:09.542064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47350 (local address 127.1.81.193:34963)
0809 02:21:09.542186 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:09.542189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:09.542226 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:21:09.542317 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:09.542319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:09.542350 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:09.542407 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:09.542796 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.543255 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.543955 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:09.544157 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:09.544225 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:09.545945 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:09.545948 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:09.545949 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:09.545971 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:09.546966 (+ 995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.547293 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.547295 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.547296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.547355 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:09.547532 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:09.547534 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:09.547535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:09.547666 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:09.547748 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:09.547925 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:21:09.548010 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:21:09.548882 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 9778
I20260809 02:21:09.562122 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 9977
I20260809 02:21:09.571877 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 10198
I20260809 02:21:09.581529 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 9628
2026-08-09T02:21:09Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2192 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[10410](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[10410](info): set up 2 sockets
Aug 09 02:21:09 dist-test-slave-jlzn krb5kdc[10410](info): commencing operation
krb5kdc: starting...
W20260809 02:21:10.692171 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:10 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:10Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.254.keytab.
Entry for principal oryx/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.254.keytab.
I20260809 02:21:10.804193 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:42057
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.254.keytab
--principal=oryx/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:42057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:10.914688 10425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:10.914917 10425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:10.914971 10425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:10.918831 10425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:10.918882 10425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:10.918910 10425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:10.918931 10425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:10.918955 10425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:10.923911 10425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:42057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.254.keytab
--principal=oryx/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:42057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:10.924784 10425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:10.925676 10425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:10.933494 10438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:10.933456 10433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:10.933462 10434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:10.933610 10425 server_base.cc:1034] running on GCE node
I20260809 02:21:10.934293 10425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:10.935221 10425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:10.936371 10425 hybrid_clock.cc:648] HybridClock initialized: now 1786242070936348 us; error 34 us; skew 500 ppm
Aug 09 02:21:10 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242070, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:10.942663 10425 init.cc:377] Logged in from keytab as oryx/127.1.81.254@KRBTEST.COM (short username oryx)
I20260809 02:21:10.943398 10425 webserver.cc:460] Webserver started at http://127.1.81.254:33803/ using document root <none> and password file <none>
I20260809 02:21:10.943902 10425 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:10.943965 10425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:10.944124 10425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:10.945889 10425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "19feb45cd9234b7eb25847b3e655e9f6"
format_stamp: "Formatted at 2026-08-09 02:21:10 on dist-test-slave-jlzn"
server_key: "8fecfd5fcf297e2b6fc1308448366b93"
server_key_iv: "479843942a6e5e4de4766d1fdf01c7dc"
server_key_version: "encryptionkey@0"
I20260809 02:21:10.946357 10425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "19feb45cd9234b7eb25847b3e655e9f6"
format_stamp: "Formatted at 2026-08-09 02:21:10 on dist-test-slave-jlzn"
server_key: "8fecfd5fcf297e2b6fc1308448366b93"
server_key_iv: "479843942a6e5e4de4766d1fdf01c7dc"
server_key_version: "encryptionkey@0"
I20260809 02:21:10.949704 10425 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:21:10.951789 10445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:10.952891 10425 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:10.952993 10425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "19feb45cd9234b7eb25847b3e655e9f6"
format_stamp: "Formatted at 2026-08-09 02:21:10 on dist-test-slave-jlzn"
server_key: "8fecfd5fcf297e2b6fc1308448366b93"
server_key_iv: "479843942a6e5e4de4766d1fdf01c7dc"
server_key_version: "encryptionkey@0"
I20260809 02:21:10.953087 10425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:10.971248 10425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:10.974099 10425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:10.974264 10425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:10.980777 10425 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:42057
I20260809 02:21:10.981050 10523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:42057 every 8 connection(s)
I20260809 02:21:10.981619 10425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:10.984212 10525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:10.989356 10525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: Bootstrap starting.
I20260809 02:21:10.989399 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 10425
I20260809 02:21:10.989519 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:10.989766 1351 external_mini_cluster.cc:1428] Setting key a5c6d775e503540145eb1aae621c41b9
I20260809 02:21:10.991854 10525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:10.992727 10525 log.cc:824] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:10.994846 10525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: No bootstrap required, opened a new log
Aug 09 02:21:10 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:10.998564 10525 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } }
I20260809 02:21:10.998791 10525 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:10.998852 10525 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19feb45cd9234b7eb25847b3e655e9f6, State: Initialized, Role: FOLLOWER
I20260809 02:21:10.999264 10525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } }
I20260809 02:21:10.999432 10525 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:10.999502 10525 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:10.999616 10525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:11.000646 10525 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } }
I20260809 02:21:11.000994 10525 leader_election.cc:302] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19feb45cd9234b7eb25847b3e655e9f6; no voters:
I20260809 02:21:11.001325 10525 leader_election.cc:288] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:11.001410 10534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:11.001601 10534 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 1 LEADER]: Becoming Leader. State: Replica: 19feb45cd9234b7eb25847b3e655e9f6, State: Running, Role: LEADER
I20260809 02:21:11.001956 10534 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } }
I20260809 02:21:11.002461 10525 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:11.004279 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:10.990955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37558 (local address 127.1.81.254:42057)
0809 02:21:10.991365 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:10.991384 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:10.991424 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:21:10.992264 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:10.992287 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:10.992668 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:10.993010 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:10.993786 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:10.995221 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:10.996093 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:10.996764 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:10.996921 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:10.999210 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:10.999216 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:10.999230 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:10.999260 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.001199 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.001710 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.001716 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.001721 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.001856 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.002189 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.002192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.002194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.002667 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.002855 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.003137 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.003405 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":113,"threads_started":1}
I20260809 02:21:11.004748 10539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19feb45cd9234b7eb25847b3e655e9f6. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } }
I20260809 02:21:11.004755 10536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } }
I20260809 02:21:11.004905 10539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:11.004912 10536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
W20260809 02:21:11.007328 10557 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:21:11.007409 10557 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:21:11.007665 10558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:11.008565 10558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:11.013996 10558 catalog_manager.cc:1347] Generated new cluster ID: ad14096474904279972f1208db4b8c0f
I20260809 02:21:11.014060 10558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:11.022502 10558 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:11.023360 10558 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:11.028465 10558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: Generated new TSK 0
I20260809 02:21:11.029016 10558 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab.
Entry for principal oryx/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab.
I20260809 02:21:11.059424 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42057
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab
--principal=oryx/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:11.174633 10567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:11.174889 10567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:11.174934 10567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:11.178824 10567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:11.178874 10567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:11.178930 10567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:11.183885 10567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab
--principal=oryx/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:11.184847 10567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:11.185803 10567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:21:11.195124 10567 server_base.cc:1034] running on GCE node
W20260809 02:21:11.195175 10577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:11.195186 10575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:11.195281 10580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:11.195722 10567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:11.196354 10567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:11.197520 10567 hybrid_clock.cc:648] HybridClock initialized: now 1786242071197495 us; error 35 us; skew 500 ppm
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:11.200137 10567 init.cc:377] Logged in from keytab as oryx/127.1.81.193@KRBTEST.COM (short username oryx)
I20260809 02:21:11.200941 10567 webserver.cc:460] Webserver started at http://127.1.81.193:36761/ using document root <none> and password file <none>
I20260809 02:21:11.201457 10567 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:11.201521 10567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:11.201726 10567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:11.203742 10567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "333629d0e916424a9eb4e6768fca6b51"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "9fea7b1ec4dbdf1dea707abb65a16f39"
server_key_iv: "7af38af9d70a9d6bdfdb94f68deea787"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.204347 10567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "333629d0e916424a9eb4e6768fca6b51"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "9fea7b1ec4dbdf1dea707abb65a16f39"
server_key_iv: "7af38af9d70a9d6bdfdb94f68deea787"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.207845 10567 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:11.210006 10590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.211090 10567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:11.211217 10567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "333629d0e916424a9eb4e6768fca6b51"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "9fea7b1ec4dbdf1dea707abb65a16f39"
server_key_iv: "7af38af9d70a9d6bdfdb94f68deea787"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.211306 10567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:11.224748 10567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:11.227397 10567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:11.227545 10567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:11.228083 10567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:11.228817 10567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:11.228865 10567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.228901 10567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:11.228920 10567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.237066 10567 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:43295
I20260809 02:21:11.237112 10766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:43295 every 8 connection(s)
I20260809 02:21:11.237948 10567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:11.245788 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 10567
I20260809 02:21:11.245898 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:11.246161 1351 external_mini_cluster.cc:1428] Setting key b5c05134eef1f537c05a50914f8b4513
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:11.250682 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.239524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:57127 (local address 127.1.81.254:42057)
0809 02:21:11.239659 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.239663 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.240500 (+ 837us) server_negotiation.cc:407] Connection header received
0809 02:21:11.241736 (+ 1236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.241739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.241796 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.241866 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.242957 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.243492 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.244649 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.244892 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.244981 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.247324 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.247328 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.247330 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.247360 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.248678 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.249215 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.249217 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.249218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.249285 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.249657 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.249660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.249662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.249873 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.249964 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.250385 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.250519 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:21:11.251330 10770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.239945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:57127)
0809 02:21:11.240365 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.240405 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.241532 (+ 1127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.242038 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.242045 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.242384 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.242811 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.242823 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.243613 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.243617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.244519 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.244530 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.245031 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.245035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.245194 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.245630 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.245645 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.247164 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.248793 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.248799 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.248812 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.249129 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.249357 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.249360 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.249362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.249549 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.249969 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.249974 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.250181 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.250324 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.250554 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":115,"threads_started":1}
I20260809 02:21:11.252490 10767 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42057
I20260809 02:21:11.252710 10767 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:11.253136 10767 heartbeater.cc:511] Master 127.1.81.254:42057 requested a full tablet report, sending...
I20260809 02:21:11.254815 10466 ts_manager.cc:194] Registered new tserver with Master: 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295)
I20260809 02:21:11.256412 10466 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:57127
WARNING: no policy specified for oryx/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab.
Entry for principal oryx/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab.
I20260809 02:21:11.272336 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42057
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab
--principal=oryx/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:11.380707 10774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:11.380944 10774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:11.380999 10774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:11.384847 10774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:11.384898 10774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:11.384972 10774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:11.389968 10774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab
--principal=oryx/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:11.390877 10774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:11.391840 10774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:11.400952 10785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:11.400954 10781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:11.401063 10782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:11.401171 10774 server_base.cc:1034] running on GCE node
I20260809 02:21:11.401536 10774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:11.402118 10774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:11.403280 10774 hybrid_clock.cc:648] HybridClock initialized: now 1786242071403265 us; error 28 us; skew 500 ppm
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:11.405957 10774 init.cc:377] Logged in from keytab as oryx/127.1.81.194@KRBTEST.COM (short username oryx)
I20260809 02:21:11.406744 10774 webserver.cc:460] Webserver started at http://127.1.81.194:37071/ using document root <none> and password file <none>
I20260809 02:21:11.407265 10774 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:11.407323 10774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:11.407514 10774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:11.409407 10774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "c51def44e77446bb91eda8c56b87b204"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "7961852723897ac7c1135b22c52f64c6"
server_key_iv: "a38416550ca29fe0722e84a53ab12796"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.409925 10774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "c51def44e77446bb91eda8c56b87b204"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "7961852723897ac7c1135b22c52f64c6"
server_key_iv: "a38416550ca29fe0722e84a53ab12796"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.413333 10774 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:11.415563 10797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.416697 10774 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:21:11.416795 10774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "c51def44e77446bb91eda8c56b87b204"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "7961852723897ac7c1135b22c52f64c6"
server_key_iv: "a38416550ca29fe0722e84a53ab12796"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.416889 10774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:11.439496 10774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:11.442018 10774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:11.442190 10774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:11.442740 10774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:11.443547 10774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:11.443594 10774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.443637 10774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:11.443667 10774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.452322 10774 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:34229
I20260809 02:21:11.452428 10956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:34229 every 8 connection(s)
I20260809 02:21:11.453194 10774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:11.457806 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 10774
I20260809 02:21:11.457937 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:11.458264 1351 external_mini_cluster.cc:1428] Setting key 534baf0d09a350edeb397108ef054eec
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:11.466871 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.454880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:35931 (local address 127.1.81.254:42057)
0809 02:21:11.455045 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.455058 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.455869 (+ 811us) server_negotiation.cc:407] Connection header received
0809 02:21:11.457151 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.457155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.457204 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.457271 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.458741 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.459323 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.460588 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.460810 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.460897 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.463398 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.463402 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.463405 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.463433 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.464981 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.465434 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.465438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.465439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.465534 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.465832 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.465835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.465836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.466066 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.466170 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.466585 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.466708 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:21:11.467532 10960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.455257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:35931)
0809 02:21:11.455705 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.455747 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.456919 (+ 1172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.457429 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.457435 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.457940 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.458570 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.458591 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.459458 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.459462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.460459 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.460470 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.460946 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.460951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.461110 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.461670 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.461691 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.463229 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.465087 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.465091 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.465101 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.465341 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.465624 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.465626 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.465628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.465752 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.466154 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.466158 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.466362 (+ 204us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.466504 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.466737 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":107,"threads_started":1}
I20260809 02:21:11.468528 10957 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42057
I20260809 02:21:11.468748 10957 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.1.81.195@KRBTEST.COM; defaulting to no policy
I20260809 02:21:11.469201 10957 heartbeater.cc:511] Master 127.1.81.254:42057 requested a full tablet report, sending...
I20260809 02:21:11.470170 10466 ts_manager.cc:194] Registered new tserver with Master: c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229)
I20260809 02:21:11.470711 10466 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:35931
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab.
Entry for principal oryx/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab.
I20260809 02:21:11.483999 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42057
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab
--principal=oryx/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:11.591771 10963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:11.592087 10963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:11.592142 10963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:11.596115 10963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:11.596164 10963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:11.596233 10963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:11.601393 10963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab
--principal=oryx/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:42057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:11.602272 10963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:11.603209 10963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:11.612198 10973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:11.612237 10971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:11.612255 10977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:11.612474 10963 server_base.cc:1034] running on GCE node
I20260809 02:21:11.612845 10963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:11.613406 10963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:11.614580 10963 hybrid_clock.cc:648] HybridClock initialized: now 1786242071614562 us; error 28 us; skew 500 ppm
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:11.617146 10963 init.cc:377] Logged in from keytab as oryx/127.1.81.195@KRBTEST.COM (short username oryx)
I20260809 02:21:11.617961 10963 webserver.cc:460] Webserver started at http://127.1.81.195:35223/ using document root <none> and password file <none>
I20260809 02:21:11.618459 10963 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:11.618525 10963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:11.618741 10963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:11.620703 10963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "715111cd7bee4c83ba4ab83b58c0cef9"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "797506f701440c590fcc02d453a53147"
server_key_iv: "866ddd6fbe860e4cfb091b263403f7fa"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.621227 10963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "715111cd7bee4c83ba4ab83b58c0cef9"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "797506f701440c590fcc02d453a53147"
server_key_iv: "866ddd6fbe860e4cfb091b263403f7fa"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.624679 10963 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:21:11.626894 10986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.628032 10963 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:21:11.628140 10963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "715111cd7bee4c83ba4ab83b58c0cef9"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "797506f701440c590fcc02d453a53147"
server_key_iv: "866ddd6fbe860e4cfb091b263403f7fa"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.628229 10963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:11.637353 10963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:11.639788 10963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:11.639997 10963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:11.640516 10963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:11.641271 10963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:11.641319 10963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.641371 10963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:11.641396 10963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.649842 10963 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:39443
I20260809 02:21:11.649875 11150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:39443 every 8 connection(s)
I20260809 02:21:11.650602 10963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:11.658880 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 10963
I20260809 02:21:11.659001 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:11.659370 1351 external_mini_cluster.cc:1428] Setting key 535f2cdd2b6e267325e628fe798f1b6d
I20260809 02:21:11.663141 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.652201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:60735 (local address 127.1.81.254:42057)
0809 02:21:11.652320 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.652324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.653039 (+ 715us) server_negotiation.cc:407] Connection header received
0809 02:21:11.654248 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.654252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.654312 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.654383 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.655444 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.656001 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.657105 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.657324 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.657412 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.659892 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.659896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.659898 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.659927 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.661256 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.661742 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.661746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.661747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.661827 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.662139 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.662143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.662144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.662311 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.662394 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.662859 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.662974 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:11.663795 11154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.652496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:60735)
0809 02:21:11.652905 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.652943 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.654042 (+ 1099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.654549 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.654555 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.654883 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.655305 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.655317 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.656115 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.656118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.656982 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.656992 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.657456 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.657460 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.657619 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.658046 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.658063 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.659636 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.661373 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.661378 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.661391 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.661645 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.661910 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.661913 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.661915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.662050 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.662411 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.662418 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.662641 (+ 223us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.662794 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.663077 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":99,"threads_started":1}
I20260809 02:21:11.664752 11151 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42057
I20260809 02:21:11.664937 11151 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:11.665337 11151 heartbeater.cc:511] Master 127.1.81.254:42057 requested a full tablet report, sending...
I20260809 02:21:11.666246 10466 ts_manager.cc:194] Registered new tserver with Master: 715111cd7bee4c83ba4ab83b58c0cef9 (127.1.81.195:39443)
I20260809 02:21:11.666780 10466 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:60735
I20260809 02:21:11.672924 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.81.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.253.keytab.
Entry for principal oryx/127.1.81.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.253.keytab.
I20260809 02:21:11.697921 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.253:33301
--webserver_interface=127.1.81.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.253.keytab
--principal=oryx/127.1.81.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:42057,127.1.81.253:33301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:11.806299 11158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:11.806529 11158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:11.806571 11158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:11.810447 11158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:11.810499 11158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:11.810516 11158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:11.810534 11158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:11.810561 11158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:11.815624 11158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:42057,127.1.81.253:33301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.253.keytab
--principal=oryx/127.1.81.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.253:33301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.81.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
W20260809 02:21:11.815826 11158 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.1.81.254:42057,127.1.81.253:33301'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 02:21:11.816596 11158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:11.817508 11158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:11.825479 11166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:11.825450 11171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:11.825467 11168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:11.825515 11158 server_base.cc:1034] running on GCE node
I20260809 02:21:11.826198 11158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:11.827180 11158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:11.828331 11158 hybrid_clock.cc:648] HybridClock initialized: now 1786242071828310 us; error 32 us; skew 500 ppm
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:11.830906 11158 init.cc:377] Logged in from keytab as oryx/127.1.81.253@KRBTEST.COM (short username oryx)
I20260809 02:21:11.831750 11158 webserver.cc:460] Webserver started at http://127.1.81.253:36919/ using document root <none> and password file <none>
I20260809 02:21:11.832293 11158 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:11.832355 11158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:11.832542 11158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:11.834452 11158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data/instance:
uuid: "2fbbbd0a5fa947d8bd9fd45a83503517"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "78f321175fbeb4a1b397d71e283ad262"
server_key_iv: "16051f7720a916d0c1597bdf744e5dd4"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.835035 11158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal/instance:
uuid: "2fbbbd0a5fa947d8bd9fd45a83503517"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "78f321175fbeb4a1b397d71e283ad262"
server_key_iv: "16051f7720a916d0c1597bdf744e5dd4"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.838454 11158 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:21:11.840636 11185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.841701 11158 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:11.841815 11158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
uuid: "2fbbbd0a5fa947d8bd9fd45a83503517"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "78f321175fbeb4a1b397d71e283ad262"
server_key_iv: "16051f7720a916d0c1597bdf744e5dd4"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.841902 11158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:11.860951 11158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:11.863785 11158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:11.863972 11158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:11.870314 11158 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.253:33301
I20260809 02:21:11.870659 11258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.253:33301 every 8 connection(s)
I20260809 02:21:11.871400 11158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
I20260809 02:21:11.873260 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 11158
I20260809 02:21:11.874226 11259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:11.878700 11259 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.81.253@KRBTEST.COM
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.253@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:11.887212 11267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.874738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43980 (local address 127.1.81.253:33301)
0809 02:21:11.875145 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.875172 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.875214 (+ 42us) server_negotiation.cc:407] Connection header received
0809 02:21:11.876047 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.876070 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.876467 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.876819 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.877442 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.878866 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.879699 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.880288 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.880434 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.882938 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.882944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.882952 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.882978 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.884557 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.884954 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.884960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.884966 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.885114 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.885379 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.885382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.885384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.885771 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.885965 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.886216 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.886467 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":109,"threads_started":1}
I20260809 02:21:11.888818 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.880443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36292 (local address 127.1.81.254:42057)
0809 02:21:11.880575 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.880579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.880930 (+ 351us) server_negotiation.cc:407] Connection header received
0809 02:21:11.881061 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.881065 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.881121 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.881211 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.881834 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.882367 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.883248 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.883455 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.883539 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.885533 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.885536 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.885538 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.885562 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.886946 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.887539 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.887543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.887544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.887641 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.887935 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.887938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.887939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.888224 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.888316 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.888617 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.888710 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:21:11.889011 11268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.880362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36292)
0809 02:21:11.880791 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.880841 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.880966 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.881259 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.881263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.881580 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.881714 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.881720 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.882495 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.882498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.883131 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.883141 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.883552 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.883556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.883671 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.884062 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.884073 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.885408 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.887050 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.887059 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.887064 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.887396 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.887735 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.887737 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.887738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.887850 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.888322 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.888327 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.888440 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.888580 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.888753 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":125,"threads_started":1}
I20260809 02:21:11.890262 11259 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242071, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.253@KRBTEST.COM for oryx/127.1.81.253@KRBTEST.COM
I20260809 02:21:11.896777 11268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.890654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.0.0.1:43994)
0809 02:21:11.890739 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.890751 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.890812 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.890971 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.890973 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.891086 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.891186 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.891191 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.892166 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.892168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.892648 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.892655 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.892993 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.892995 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.893056 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.893376 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.893386 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.894362 (+ 976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.895730 (+ 1368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.895732 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.895734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.895931 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.896135 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.896137 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.896144 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.896208 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.896452 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.896454 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.896520 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.896587 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.896681 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 02:21:11.896859 11267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.890688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43994 (local address 127.1.81.253:33301)
0809 02:21:11.890788 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.890791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.890803 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:11.890872 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.890874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.890906 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.890964 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.891261 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.892080 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.892726 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.892924 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.892986 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.894473 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.894475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.894477 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.894499 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.895647 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.896001 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.896003 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.896004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.896071 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.896259 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.896261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.896262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.896394 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.896457 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.896632 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.896734 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":38}
I20260809 02:21:11.899168 11259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Bootstrap starting.
I20260809 02:21:11.901363 11259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:11.902073 11259 log.cc:824] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:11.903851 11259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: No bootstrap required, opened a new log
I20260809 02:21:11.906654 11259 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } }
I20260809 02:21:11.906844 11259 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:11.906903 11259 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbbbd0a5fa947d8bd9fd45a83503517, State: Initialized, Role: FOLLOWER
I20260809 02:21:11.907279 11259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } }
I20260809 02:21:11.907692 11272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } } }
I20260809 02:21:11.907830 11272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:11.908368 11259 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:21:11.912585 11289 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:21:11.912659 11289 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:21:11.914606 11158 master_runner.cc:428] Detected that this master 2fbbbd0a5fa947d8bd9fd45a83503517 is joining an existing cluster
I20260809 02:21:11.914656 11158 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.81.253:33301
I20260809 02:21:11.924185 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.916556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36306 (local address 127.1.81.254:42057)
0809 02:21:11.916671 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.916675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.916845 (+ 170us) server_negotiation.cc:407] Connection header received
0809 02:21:11.916939 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.916942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.916982 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.917045 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.917542 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.918188 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.919425 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.919745 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.919856 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.920956 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.920960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.920962 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.920987 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.922579 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.923003 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.923006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.923008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.923085 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.923398 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.923401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.923403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.923570 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.923661 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.923948 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.924046 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:21:11.924204 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.916520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36306)
0809 02:21:11.916758 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.916772 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.916870 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.917085 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.917088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.917296 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.917416 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.917423 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.918297 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.918301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.919312 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.919324 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.919865 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.919869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.920001 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.920490 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.920504 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.920831 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.922713 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.922716 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.922718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.922916 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.923190 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.923193 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.923195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.923291 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.923662 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.923665 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.923768 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.923880 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.924016 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":25,"thread_start_us":85,"threads_started":1}
I20260809 02:21:11.924371 11267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.916911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44010 (local address 127.1.81.253:33301)
0809 02:21:11.917002 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.917006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.917213 (+ 207us) server_negotiation.cc:407] Connection header received
0809 02:21:11.917302 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.917305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.917340 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.917414 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.917904 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.918509 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.919334 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.919622 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.919718 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.920982 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.920985 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.920988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.921007 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.922711 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.923164 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.923167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.923168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.923264 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.923545 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.923548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.923550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.923744 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.923842 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.924127 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.924228 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":38}
I20260809 02:21:11.925272 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.916579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.0.0.1:44010)
0809 02:21:11.917124 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.917135 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.917233 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.917440 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.917443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.917662 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.917790 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.917797 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.918622 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.918626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.919236 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.919244 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.919742 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.919745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.919895 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.920376 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.920392 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.920850 (+ 458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.922812 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.922816 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.922818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.923058 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.923350 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.923353 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.923355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.923447 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.923901 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.923904 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.923987 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.924981 (+ 994us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.925105 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":50,"spinlock_wait_cycles":12032,"thread_start_us":104,"threads_started":1}
Aug 09 02:21:11 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242070, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.254@KRBTEST.COM for oryx/127.1.81.253@KRBTEST.COM
I20260809 02:21:11.936097 11267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.927956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44012 (local address 127.1.81.253:33301)
0809 02:21:11.928058 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.928061 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.928451 (+ 390us) server_negotiation.cc:407] Connection header received
0809 02:21:11.928622 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.928625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.928680 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.928758 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.929293 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.930002 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.930773 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.931152 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.931249 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.933404 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.933407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.933409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.933430 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.934544 (+ 1114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.935039 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.935041 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.935042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.935103 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.935333 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.935335 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.935336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.935490 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.935560 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.935927 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.936007 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:21:11.936218 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.928025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.0.0.1:44012)
0809 02:21:11.928333 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.928380 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.928503 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.928810 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.928815 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.929104 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.929199 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.929205 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.930084 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.930086 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.930678 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.930686 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.931262 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.931265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.931374 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.931863 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.931877 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.933276 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.934651 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.934660 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.934666 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.934955 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.935170 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.935173 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.935175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.935263 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.935575 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.935581 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.935703 (+ 122us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.935885 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.936059 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":71,"threads_started":1}
I20260809 02:21:11.937362 10466 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.81.253:33301: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517"
member_type: NON_VOTER
last_known_addr {
host: "127.1.81.253"
port: 33301
}
attrs {
promote: true
}
}
dest_uuid: "19feb45cd9234b7eb25847b3e655e9f6"
cas_config_opid_index: -1
I20260809 02:21:11.937912 10466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } }
I20260809 02:21:11.939286 11314 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2fbbbd0a5fa947d8bd9fd45a83503517 (127.1.81.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } }
I20260809 02:21:11.940065 11224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:11.941421 11224 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Refusing update from remote peer 19feb45cd9234b7eb25847b3e655e9f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 02:21:11.942082 11310 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:11.943917 11314 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.81.253:33301
I20260809 02:21:11.944352 11158 master.cc:537] Master@127.1.81.253:33301 shutting down...
I20260809 02:21:11.948164 11310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } }
I20260809 02:21:11.948269 11310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:11.948132 11224 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2fbbbd0a5fa947d8bd9fd45a83503517 (127.1.81.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } }
I20260809 02:21:11.950398 11272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19feb45cd9234b7eb25847b3e655e9f6. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } }
I20260809 02:21:11.950502 11272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:21:11.950584 11272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } }
I20260809 02:21:11.950657 11272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:21:11.950729 11272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } }
I20260809 02:21:11.950793 11272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:21:11.950843 11317 mvcc.cc:205] Tried to move back new op lower bound from 7316447522928988160 to 7316447522825125888. Current Snapshot: MvccSnapshot[applied={T|T < 7316447522864517120}]
WARNING: no policy specified for oryx/127.1.81.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.252@KRBTEST.COM" created.
I20260809 02:21:11.953728 11158 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 LEARNER]: Raft consensus shutting down.
I20260809 02:21:11.954018 11158 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 LEARNER]: Raft consensus is shut down!
I20260809 02:21:11.954107 11158 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.252.keytab.
Entry for principal oryx/127.1.81.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.252.keytab.
I20260809 02:21:11.968498 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.252:42659
--webserver_interface=127.1.81.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.252.keytab
--principal=oryx/127.1.81.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:42057,127.1.81.253:33301,127.1.81.252:42659
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:11.969568 11158 master.cc:552] Master@127.1.81.253:33301 shutdown complete.
I20260809 02:21:11.969614 11158 master_runner.cc:305] Clearing existing system tablet
I20260809 02:21:11.969863 11158 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:11.969923 11158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:11.971175 11158 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:21:11.972180 11331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:11.972419 11158 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:11.972543 11158 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:11.972575 11158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
uuid: "2fbbbd0a5fa947d8bd9fd45a83503517"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "78f321175fbeb4a1b397d71e283ad262"
server_key_iv: "16051f7720a916d0c1597bdf744e5dd4"
server_key_version: "encryptionkey@0"
I20260809 02:21:11.974359 11158 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:11.976742 11158 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 02:21:11.976828 11158 log.cc:1196] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 02:21:11.977097 11158 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Deleting consensus metadata
I20260809 02:21:11.977265 11158 master_runner.cc:315] Copying system tablet from 127.1.81.254:42057
I20260809 02:21:11.978593 11158 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: tablet copy: Beginning tablet copy session from remote peer at address 127.1.81.254:42057
I20260809 02:21:11.987560 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.979276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36322 (local address 127.1.81.254:42057)
0809 02:21:11.979399 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:11.979403 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:11.979567 (+ 164us) server_negotiation.cc:407] Connection header received
0809 02:21:11.979687 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:11.979690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:11.979741 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:11.979865 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:11.980351 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.981162 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.982379 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.982728 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.982797 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.984193 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:11.984197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:11.984200 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:11.984225 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:11.985814 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.986289 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.986292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.986294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.986376 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:11.986678 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:11.986682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:11.986684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:11.986883 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:11.986950 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:11.987290 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 02:21:11.987401 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:21:11.988133 11341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:11.979193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36322)
0809 02:21:11.979478 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:11.979492 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:11.979605 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:11.979880 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:11.979883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:11.980096 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:11.980238 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.980245 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.981301 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.981305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.982241 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:11.982252 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:11.982955 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:11.982959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:11.983052 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:11.983584 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:11.983599 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:11.984044 (+ 445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:11.985944 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.985947 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.985950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.986182 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.986482 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:11.986485 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:11.986486 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:11.986568 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:11.987021 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:11.987024 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:11.987116 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 02:21:11.987817 (+ 701us) client_negotiation.cc:240] Negotiation successful
0809 02:21:11.987963 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":80,"threads_started":1}
I20260809 02:21:11.988691 10500 tablet_copy_service.cc:140] P 19feb45cd9234b7eb25847b3e655e9f6: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2fbbbd0a5fa947d8bd9fd45a83503517 ({username='oryx', principal='oryx/127.1.81.253@KRBTEST.COM'} at 127.0.0.1:36322)
I20260809 02:21:11.988860 10500 tablet_copy_service.cc:161] P 19feb45cd9234b7eb25847b3e655e9f6: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2fbbbd0a5fa947d8bd9fd45a83503517 at {username='oryx', principal='oryx/127.1.81.253@KRBTEST.COM'} at 127.0.0.1:36322: session id = 2fbbbd0a5fa947d8bd9fd45a83503517-00000000000000000000000000000000
I20260809 02:21:11.990607 10500 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 02:21:11.992604 11158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 02:21:11.994828 11158 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: tablet copy: Starting download of 0 data blocks...
I20260809 02:21:11.995077 11158 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: tablet copy: Starting download of 1 WAL segments...
I20260809 02:21:11.996711 11158 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 02:21:11.998462 10500 tablet_copy_service.cc:342] P 19feb45cd9234b7eb25847b3e655e9f6: Request end of tablet copy session 2fbbbd0a5fa947d8bd9fd45a83503517-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.81.253@KRBTEST.COM'} at 127.0.0.1:36322
I20260809 02:21:11.998574 10500 tablet_copy_service.cc:433] P 19feb45cd9234b7eb25847b3e655e9f6: ending tablet copy session 2fbbbd0a5fa947d8bd9fd45a83503517-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2fbbbd0a5fa947d8bd9fd45a83503517
I20260809 02:21:12.005610 11158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:12.007200 11342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.008456 11343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.008905 11347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:12.009155 11158 server_base.cc:1034] running on GCE node
I20260809 02:21:12.009302 11158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:12.009593 11158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:12.010742 11158 hybrid_clock.cc:648] HybridClock initialized: now 1786242072010728 us; error 28 us; skew 500 ppm
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:12.012372 11158 init.cc:377] Logged in from keytab as oryx/127.1.81.253@KRBTEST.COM (short username oryx)
I20260809 02:21:12.012821 11158 webserver.cc:460] Webserver started at http://127.1.81.253:36733/ using document root <none> and password file <none>
I20260809 02:21:12.013006 11158 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:12.013051 11158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:12.014245 11158 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:12.015241 11356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.015473 11158 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:12.015547 11158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
uuid: "2fbbbd0a5fa947d8bd9fd45a83503517"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "78f321175fbeb4a1b397d71e283ad262"
server_key_iv: "16051f7720a916d0c1597bdf744e5dd4"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.015615 11158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:12.054311 11158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:12.056485 11158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:12.061498 11158 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.253:33301
I20260809 02:21:12.061609 11439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.253:33301 every 8 connection(s)
I20260809 02:21:12.062078 11158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
I20260809 02:21:12.064005 11440 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:21:12.065081 11440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Bootstrap starting.
I20260809 02:21:12.072777 11440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:21:12.073050 11440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: Bootstrap complete.
I20260809 02:21:12.073596 11440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } }
I20260809 02:21:12.073727 11440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fbbbd0a5fa947d8bd9fd45a83503517, State: Initialized, Role: LEARNER
I20260809 02:21:12.073838 11440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } }
I20260809 02:21:12.074154 11443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } }
I20260809 02:21:12.074290 11440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:12.074328 11443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:21:12.077425 11458 catalog_manager.cc:1259] Loaded cluster ID: ad14096474904279972f1208db4b8c0f
I20260809 02:21:12.077543 11458 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: loading cluster ID for follower catalog manager: success
I20260809 02:21:12.079294 11458 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: acquiring CA information for follower catalog manager: success
I20260809 02:21:12.080433 11458 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 02:21:12.098187 11329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:12.098408 11329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:12.098453 11329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:12.102414 11329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:12.102466 11329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:12.102491 11329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:12.102521 11329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:12.102541 11329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:12.107573 11329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:42057,127.1.81.253:33301,127.1.81.252:42659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.252.keytab
--principal=oryx/127.1.81.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.252:42659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.81.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:12.108481 11329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:12.109373 11329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:12.117209 11467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.117255 11471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:12.117419 11329 server_base.cc:1034] running on GCE node
W20260809 02:21:12.117578 11468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:12.118108 11329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:12.119048 11329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:12.120204 11329 hybrid_clock.cc:648] HybridClock initialized: now 1786242072120188 us; error 25 us; skew 500 ppm
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:12.122833 11329 init.cc:377] Logged in from keytab as oryx/127.1.81.252@KRBTEST.COM (short username oryx)
I20260809 02:21:12.123596 11329 webserver.cc:460] Webserver started at http://127.1.81.252:33527/ using document root <none> and password file <none>
I20260809 02:21:12.124119 11329 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:12.124199 11329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:12.124368 11329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:12.126187 11329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data/instance:
uuid: "ca5f4539f8944cc7837ef80855452f3c"
format_stamp: "Formatted at 2026-08-09 02:21:12 on dist-test-slave-jlzn"
server_key: "43cc755345f3bc40d76dc63fb8cba729"
server_key_iv: "ef634f6da63495cb78e5e6bff1cbed49"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.126731 11329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal/instance:
uuid: "ca5f4539f8944cc7837ef80855452f3c"
format_stamp: "Formatted at 2026-08-09 02:21:12 on dist-test-slave-jlzn"
server_key: "43cc755345f3bc40d76dc63fb8cba729"
server_key_iv: "ef634f6da63495cb78e5e6bff1cbed49"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.130090 11329 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260809 02:21:12.132357 11479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.133469 11329 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:21:12.133577 11329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
uuid: "ca5f4539f8944cc7837ef80855452f3c"
format_stamp: "Formatted at 2026-08-09 02:21:12 on dist-test-slave-jlzn"
server_key: "43cc755345f3bc40d76dc63fb8cba729"
server_key_iv: "ef634f6da63495cb78e5e6bff1cbed49"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.133669 11329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:12.152609 11329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:12.155367 11329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:12.155526 11329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:12.164587 11329 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.252:42659
I20260809 02:21:12.164867 11558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.252:42659 every 8 connection(s)
I20260809 02:21:12.165416 11329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
I20260809 02:21:12.168004 11559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:12.171510 11559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:21:12.174867 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 11329
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.252@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.81.252@KRBTEST.COM
I20260809 02:21:12.184419 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.173235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36326 (local address 127.1.81.254:42057)
0809 02:21:12.173359 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.173362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.174035 (+ 673us) server_negotiation.cc:407] Connection header received
0809 02:21:12.174979 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.174982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.175041 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.175104 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.176462 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.177002 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.178132 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.178359 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.178438 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.180927 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.180931 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.180934 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.180965 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.182323 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.182878 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.182882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.182883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.182981 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.183321 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.183325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.183327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.183544 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.183653 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.184155 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.184255 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:21:12.185362 11561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.173498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36326)
0809 02:21:12.173897 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.173936 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.174782 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.175290 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.175296 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.175662 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.176302 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.176321 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.177189 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.177192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.178003 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.178013 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.178497 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.178500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.178709 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.179221 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.179240 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.180787 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.182428 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.182437 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.182447 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.182784 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.183066 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.183069 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.183071 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.183226 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.183637 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.183642 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.183894 (+ 252us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.184088 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.184501 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":102,"threads_started":1}
I20260809 02:21:12.185699 11563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.175671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58344 (local address 127.1.81.252:42659)
0809 02:21:12.175995 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.176004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.176022 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:21:12.176055 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.176059 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.176229 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.176378 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.177065 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.178010 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.179019 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.179494 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.179594 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.182182 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.182190 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.182201 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.182227 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.183856 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.184310 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.184315 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.184317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.184400 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.184757 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.184761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.184763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.184975 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.185112 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.185352 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.185466 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":155,"threads_started":1}
I20260809 02:21:12.186512 11559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.252@KRBTEST.COM for oryx/127.1.81.253@KRBTEST.COM
I20260809 02:21:12.193749 11561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.186933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.0.0.1:44020)
0809 02:21:12.187448 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.187462 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.187554 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.187778 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.187780 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.187927 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.188011 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.188016 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.188856 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.188859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.189374 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.189382 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.189731 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.189734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.189799 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.190178 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.190190 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.191218 (+ 1028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.192700 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.192703 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.192705 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.192892 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.193089 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.193091 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.193092 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.193157 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.193424 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.193425 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.193490 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.193557 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.193652 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459}
I20260809 02:21:12.193801 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.187067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.1.81.253:33301)
0809 02:21:12.187296 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.187299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.187527 (+ 228us) server_negotiation.cc:407] Connection header received
0809 02:21:12.187638 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.187641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.187687 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.187759 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.188102 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.188760 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.189457 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.189661 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.189723 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.191336 (+ 1613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.191339 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.191341 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.191360 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.192600 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.192963 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.192965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.192966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.193031 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.193214 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.193216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.193217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.193364 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.193429 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.193597 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.193685 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":82,"threads_started":1}
I20260809 02:21:12.194413 11559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.252@KRBTEST.COM for oryx/127.1.81.252@KRBTEST.COM
I20260809 02:21:12.201490 11561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.194776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.0.0.1:58360)
0809 02:21:12.194878 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.194891 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.194967 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.195148 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.195150 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.195282 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.195337 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.195342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.196086 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.196089 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.196558 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.196565 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.197463 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.197467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.197537 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.197892 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.197905 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.198897 (+ 992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.200403 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.200405 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.200406 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.200578 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.200784 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.200786 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.200787 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.200846 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.201158 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.201159 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.201225 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.201294 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.201374 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:21:12.201558 11563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.194817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58360 (local address 127.1.81.252:42659)
0809 02:21:12.194899 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.194902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.194931 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:21:12.195034 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.195037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.195069 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.195126 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.195432 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.195932 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.196657 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.197360 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.197452 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.199010 (+ 1558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.199013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.199015 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.199034 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.200310 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.200648 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.200652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.200653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.200723 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.200904 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.200906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.200907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.201092 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.201171 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.201339 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.201419 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 02:21:12.204180 11559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Bootstrap starting.
I20260809 02:21:12.206519 11559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:12.207211 11559 log.cc:824] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:12.208927 11559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: No bootstrap required, opened a new log
I20260809 02:21:12.211961 11559 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } }
I20260809 02:21:12.212143 11559 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:12.212203 11559 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca5f4539f8944cc7837ef80855452f3c, State: Initialized, Role: FOLLOWER
I20260809 02:21:12.212584 11559 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } }
I20260809 02:21:12.212990 11566 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } } }
I20260809 02:21:12.213171 11566 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:12.213663 11559 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:21:12.218590 11585 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:21:12.218664 11585 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:21:12.221699 11329 master_runner.cc:428] Detected that this master ca5f4539f8944cc7837ef80855452f3c is joining an existing cluster
I20260809 02:21:12.221760 11329 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.81.252:42659
I20260809 02:21:12.233409 11563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.225285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58366 (local address 127.1.81.252:42659)
0809 02:21:12.225377 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.225381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.225655 (+ 274us) server_negotiation.cc:407] Connection header received
0809 02:21:12.225787 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.225790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.225822 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.225863 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.226578 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.227295 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.228666 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.229207 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.229297 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.230229 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.230232 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.230235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.230258 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.231712 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.232178 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.232181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.232182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.232259 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.232581 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.232583 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.232585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.232799 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.232874 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.233138 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.233282 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":269,"server-negotiator.queue_time_us":38,"spinlock_wait_cycles":23808}
I20260809 02:21:12.233440 11597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.224982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.0.0.1:58366)
0809 02:21:12.225538 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.225551 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.225703 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.225958 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.225960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.226365 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.226466 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.226473 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.227630 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.227633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.228555 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.228566 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.229308 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.229312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.229393 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.229771 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.229784 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.230106 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.231846 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.231849 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.231851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.232081 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.232346 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.232349 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.232351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.232500 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.232893 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.232897 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.232995 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.233101 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.233233 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":28,"thread_start_us":106,"threads_started":1}
I20260809 02:21:12.238732 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 10567
I20260809 02:21:12.252485 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.224552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44034 (local address 127.1.81.253:33301)
0809 02:21:12.224672 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.224676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.224906 (+ 230us) server_negotiation.cc:407] Connection header received
0809 02:21:12.225082 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.225085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.225137 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.225188 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.225814 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.226527 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.227740 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.228096 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.228172 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.248589 (+ 20417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.248592 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.248595 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.248620 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.250559 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.251038 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.251042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.251043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.251125 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.251424 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.251427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.251429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.251675 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.251751 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.252179 (+ 428us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.252325 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:21:12.252610 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.224120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36330 (local address 127.1.81.254:42057)
0809 02:21:12.224236 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.224240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.224485 (+ 245us) server_negotiation.cc:407] Connection header received
0809 02:21:12.224689 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.224693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.224743 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.224822 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.225589 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.226389 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.227856 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.228187 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.228261 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.249286 (+ 21025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.249290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.249293 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.249324 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.250803 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.251280 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.251284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.251286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.251370 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.251688 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.251692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.251694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.251929 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.251998 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.252338 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.252455 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:12.252974 11595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.224136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.0.0.1:44034)
0809 02:21:12.224827 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.224841 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.224972 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.225342 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.225345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.225546 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.225694 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.225701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.226645 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.226659 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.227596 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.227606 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.228317 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.228320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.228412 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.228894 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.228908 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.248464 (+ 19556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.250706 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.250709 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.250711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.250931 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.251231 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.251234 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.251235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.251322 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.251862 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.251864 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.251980 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.252623 (+ 643us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.252786 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":1,"thread_start_us":140,"threads_started":1}
I20260809 02:21:12.253275 11594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.224056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36330)
0809 02:21:12.224402 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.224416 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.224556 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.224956 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.224960 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.225248 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.225450 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.225460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.226530 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.226533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.227682 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.227694 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.228413 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.228416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.228890 (+ 474us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.229356 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.229388 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.248237 (+ 18849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.250933 (+ 2696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.250936 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.250938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.251170 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.251474 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.251477 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.251479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.251578 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.252071 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.252073 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.252162 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.252807 (+ 645us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.252949 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":88,"thread_start_us":146,"threads_started":1}
I20260809 02:21:12.257815 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:43295
--local_ip_for_outbound_sockets=127.1.81.193
--tserver_master_addrs=127.1.81.254:42057
--webserver_port=36761
--webserver_interface=127.1.81.193
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab
--principal=oryx/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301,127.1.81.252:42659 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242070, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.254@KRBTEST.COM for oryx/127.1.81.252@KRBTEST.COM
I20260809 02:21:12.265935 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.257060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.0.0.1:58370)
0809 02:21:12.257235 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.257248 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.257316 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.257800 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.257804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.257982 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.258079 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.258086 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.259085 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.259088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.259975 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.259986 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.260515 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.260518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.260610 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.261035 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.261049 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.262523 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.264439 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.264442 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.264444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.264692 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.264968 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.264971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.264973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.265059 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.265455 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.265458 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.265550 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.265654 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.265783 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 02:21:12.265969 11563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.257117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58370 (local address 127.1.81.252:42659)
0809 02:21:12.257554 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.257558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.257571 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:12.257633 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.257636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.257683 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.257761 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.258211 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.258960 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.260085 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.260406 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.260511 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.262691 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.262695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.262698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.262724 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.264327 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.264792 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.264795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.264797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.264881 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.265147 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.265149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.265151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.265352 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.265449 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.265722 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.265831 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366}
I20260809 02:21:12.267047 10466 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.81.252:42659: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c"
member_type: NON_VOTER
last_known_addr {
host: "127.1.81.252"
port: 42659
}
attrs {
promote: true
}
}
dest_uuid: "19feb45cd9234b7eb25847b3e655e9f6"
cas_config_opid_index: 5
I20260809 02:21:12.267658 10466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } }
I20260809 02:21:12.268802 11314 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER ca5f4539f8944cc7837ef80855452f3c (127.1.81.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.269807 11522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:12.270167 11314 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.81.252:42659
I20260809 02:21:12.270347 11314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.270445 11314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:12.270969 11329 master.cc:537] Master@127.1.81.252:42659 shutting down...
I20260809 02:21:12.271032 11522 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Refusing update from remote peer 19feb45cd9234b7eb25847b3e655e9f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 02:21:12.271999 11310 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 02:21:12.274159 10450 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 02:21:12.275923 10450 consensus_peers.cc:487] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 -> Peer ca5f4539f8944cc7837ef80855452f3c (127.1.81.252:42659): Couldn't send request to peer ca5f4539f8944cc7837ef80855452f3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 02:21:12.276160 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.269195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44048 (local address 127.1.81.253:33301)
0809 02:21:12.269535 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.269538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.271554 (+ 2016us) server_negotiation.cc:407] Connection header received
0809 02:21:12.271600 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.271603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.271671 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.271749 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:12.272087 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.272843 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.274332 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.275145 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.275268 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.275422 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.275972 (+ 550us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.276046 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261}
I20260809 02:21:12.278461 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.268887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.0.0.1:44048)
0809 02:21:12.271372 (+ 2485us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.271386 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.271463 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.271884 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.271887 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.271904 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:12.271975 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.271980 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.272971 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.272975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.274193 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.274204 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.275520 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.275523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.275683 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.275728 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.275794 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.275873 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2414}
I20260809 02:21:12.278643 11329 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:12.278913 11329 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:12.279008 11329 tablet_replica.cc:330] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: stopping tablet replica
I20260809 02:21:12.279222 11402 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 LEARNER]: Refusing update from remote peer 19feb45cd9234b7eb25847b3e655e9f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 02:21:12.279634 11310 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 02:21:12.280730 11402 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER ca5f4539f8944cc7837ef80855452f3c (127.1.81.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.282300 11443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19feb45cd9234b7eb25847b3e655e9f6. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.282430 11443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:21:12.282508 11601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: NON_VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: true } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.282677 11601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:21:12.283574 11310 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: attempting to promote NON_VOTER 2fbbbd0a5fa947d8bd9fd45a83503517 to VOTER
I20260809 02:21:12.284003 11310 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } }
I20260809 02:21:12.285109 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.284857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.0.0.1:58378)
0809 02:21:12.284984 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.285046 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 02:21:12.285180 11402 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 LEARNER]: Refusing update from remote peer 19feb45cd9234b7eb25847b3e655e9f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 02:21:12.285637 11310 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 02:21:12.286007 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.285787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.0.0.1:58382)
0809 02:21:12.285905 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.285947 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260809 02:21:12.286116 10450 consensus_peers.cc:487] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 -> Peer ca5f4539f8944cc7837ef80855452f3c (127.1.81.252:42659): Couldn't send request to peer ca5f4539f8944cc7837ef80855452f3c. Status: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 02:21:12.286976 11329 master.cc:552] Master@127.1.81.252:42659 shutdown complete.
I20260809 02:21:12.287024 11329 master_runner.cc:305] Clearing existing system tablet
I20260809 02:21:12.287230 11310 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2fbbbd0a5fa947d8bd9fd45a83503517 (127.1.81.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.287510 11329 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:12.287575 11329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:12.288769 11329 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:12.289182 11402 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2fbbbd0a5fa947d8bd9fd45a83503517 (127.1.81.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.290892 11314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.290993 11314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:12.291181 11310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.291270 11310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:12.291431 11601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.291548 11601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:12.291941 11607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.292165 11329 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:12.292275 11329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:21:12.292307 11329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
uuid: "ca5f4539f8944cc7837ef80855452f3c"
format_stamp: "Formatted at 2026-08-09 02:21:12 on dist-test-slave-jlzn"
server_key: "43cc755345f3bc40d76dc63fb8cba729"
server_key_iv: "ef634f6da63495cb78e5e6bff1cbed49"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.294250 11329 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:12.296605 11329 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 02:21:12.296700 11329 log.cc:1196] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 02:21:12.296931 11329 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Deleting consensus metadata
I20260809 02:21:12.297086 11329 master_runner.cc:315] Copying system tablet from 127.1.81.254:42057
I20260809 02:21:12.298162 11329 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: tablet copy: Beginning tablet copy session from remote peer at address 127.1.81.254:42057
I20260809 02:21:12.306754 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.298685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36346 (local address 127.1.81.254:42057)
0809 02:21:12.298782 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.298786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.299004 (+ 218us) server_negotiation.cc:407] Connection header received
0809 02:21:12.299113 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.299116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.299158 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.299239 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.299683 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.300479 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.301572 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.301907 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.302014 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.303213 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.303217 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.303220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.303246 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.305019 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.305511 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.305515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.305517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.305646 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.305934 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.305937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.305939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.306140 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.306234 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.306502 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.306620 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:21:12.306774 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.298620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36346)
0809 02:21:12.298918 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.298931 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.299038 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.299269 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.299271 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.299474 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.299573 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.299580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.300591 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.300595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.301447 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.301459 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.302037 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.302041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.302126 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.302669 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.302684 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.303080 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.305134 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.305137 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.305139 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.305417 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.305740 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.305743 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.305745 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.305838 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.306229 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.306231 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.306334 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.306444 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.306576 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":96,"threads_started":1}
I20260809 02:21:12.307374 10500 tablet_copy_service.cc:140] P 19feb45cd9234b7eb25847b3e655e9f6: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ca5f4539f8944cc7837ef80855452f3c ({username='oryx', principal='oryx/127.1.81.252@KRBTEST.COM'} at 127.0.0.1:36346)
I20260809 02:21:12.307475 10500 tablet_copy_service.cc:161] P 19feb45cd9234b7eb25847b3e655e9f6: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ca5f4539f8944cc7837ef80855452f3c at {username='oryx', principal='oryx/127.1.81.252@KRBTEST.COM'} at 127.0.0.1:36346: session id = ca5f4539f8944cc7837ef80855452f3c-00000000000000000000000000000000
I20260809 02:21:12.308495 10500 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 02:21:12.309744 11329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 02:21:12.311992 11329 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: tablet copy: Starting download of 0 data blocks...
I20260809 02:21:12.312242 11329 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: tablet copy: Starting download of 1 WAL segments...
I20260809 02:21:12.313835 11329 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 02:21:12.315692 10500 tablet_copy_service.cc:342] P 19feb45cd9234b7eb25847b3e655e9f6: Request end of tablet copy session ca5f4539f8944cc7837ef80855452f3c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.81.252@KRBTEST.COM'} at 127.0.0.1:36346
I20260809 02:21:12.315783 10500 tablet_copy_service.cc:433] P 19feb45cd9234b7eb25847b3e655e9f6: ending tablet copy session ca5f4539f8944cc7837ef80855452f3c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ca5f4539f8944cc7837ef80855452f3c
I20260809 02:21:12.323194 11329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:12.324887 11619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.324913 11620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.331638 11623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:12.332012 11329 server_base.cc:1034] running on GCE node
I20260809 02:21:12.332209 11329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:12.332523 11329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:12.333685 11329 hybrid_clock.cc:648] HybridClock initialized: now 1786242072333673 us; error 44 us; skew 500 ppm
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:12.335232 11329 init.cc:377] Logged in from keytab as oryx/127.1.81.252@KRBTEST.COM (short username oryx)
I20260809 02:21:12.335733 11329 webserver.cc:460] Webserver started at http://127.1.81.252:40893/ using document root <none> and password file <none>
I20260809 02:21:12.335954 11329 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:12.336001 11329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:12.337277 11329 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:12.338279 11630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.338534 11329 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:12.338613 11329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
uuid: "ca5f4539f8944cc7837ef80855452f3c"
format_stamp: "Formatted at 2026-08-09 02:21:12 on dist-test-slave-jlzn"
server_key: "43cc755345f3bc40d76dc63fb8cba729"
server_key_iv: "ef634f6da63495cb78e5e6bff1cbed49"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.338707 11329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:12.355333 11329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:12.357668 11329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:12.362676 11329 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.252:42659
I20260809 02:21:12.362772 11720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.252:42659 every 8 connection(s)
I20260809 02:21:12.363241 11329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
I20260809 02:21:12.365103 11721 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:21:12.366665 11721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Bootstrap starting.
I20260809 02:21:12.377720 11721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:21:12.377995 11721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Bootstrap complete.
I20260809 02:21:12.378574 11721 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } }
I20260809 02:21:12.378718 11721 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca5f4539f8944cc7837ef80855452f3c, State: Initialized, Role: LEARNER
I20260809 02:21:12.378834 11721 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } }
I20260809 02:21:12.379621 11726 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.379758 11726 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: This master's current role is: LEARNER
I20260809 02:21:12.379781 11721 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:12.384466 11741 catalog_manager.cc:1259] Loaded cluster ID: ad14096474904279972f1208db4b8c0f
I20260809 02:21:12.384548 11741 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: loading cluster ID for follower catalog manager: success
I20260809 02:21:12.386842 11741 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: acquiring CA information for follower catalog manager: success
I20260809 02:21:12.388356 11741 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 02:21:12.406713 11598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:12.406944 11598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:12.406997 11598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:12.410990 11598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:12.411042 11598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:12.411111 11598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:12.416330 11598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab
--principal=oryx/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:43295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=36761
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301,127.1.81.252:42659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:12.417337 11598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:12.418299 11598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:12.427779 11754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.427784 11748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.427910 11751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:12.428041 11598 server_base.cc:1034] running on GCE node
I20260809 02:21:12.428460 11598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:12.429028 11598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:12.430186 11598 hybrid_clock.cc:648] HybridClock initialized: now 1786242072430171 us; error 26 us; skew 500 ppm
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:12.432905 11598 init.cc:377] Logged in from keytab as oryx/127.1.81.193@KRBTEST.COM (short username oryx)
I20260809 02:21:12.433679 11598 webserver.cc:460] Webserver started at http://127.1.81.193:36761/ using document root <none> and password file <none>
I20260809 02:21:12.434190 11598 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:12.434273 11598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:12.437901 11598 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.002s
I20260809 02:21:12.439913 11769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.441103 11598 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:12.441220 11598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "333629d0e916424a9eb4e6768fca6b51"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "9fea7b1ec4dbdf1dea707abb65a16f39"
server_key_iv: "7af38af9d70a9d6bdfdb94f68deea787"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.441717 11598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:12.454572 11598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:12.457270 11598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:12.457427 11598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:12.457929 11598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:12.458729 11598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:12.458777 11598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.458827 11598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:12.458856 11598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.467840 11598 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:43295
I20260809 02:21:12.467876 11960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:43295 every 8 connection(s)
I20260809 02:21:12.468744 11598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:12.472950 10957 heartbeater.cc:503] Master 127.1.81.254:42057 was elected leader, sending a full tablet report...
I20260809 02:21:12.478668 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 11598
I20260809 02:21:12.478849 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 10774
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.252@KRBTEST.COM
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.253@KRBTEST.COM
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:12.497033 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.470372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:39451 (local address 127.1.81.253:33301)
0809 02:21:12.470523 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.470528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.471660 (+ 1132us) server_negotiation.cc:407] Connection header received
0809 02:21:12.472523 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.472527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.472593 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.472660 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.474193 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.475022 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.476766 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.477015 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.477133 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.492535 (+ 15402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.492538 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.492541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.492571 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.494322 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.494944 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.494948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.494950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.495038 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.495436 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.495439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.495441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.495674 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.495770 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.496762 (+ 992us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.496876 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 02:21:12.498030 11969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.471578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.1.81.193:42625)
0809 02:21:12.471884 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.471897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.472228 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.472747 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.472753 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.473353 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.474024 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.474046 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.475181 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.475185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.476428 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.476438 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.476996 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.477000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.477196 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.477755 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.477777 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.492314 (+ 14537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.494778 (+ 2464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.494782 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.494784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.495009 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.495309 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.495312 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.495314 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.495392 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.495852 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.495860 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.496260 (+ 400us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.496466 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.496849 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":222,"spinlock_wait_cycles":22656,"thread_start_us":95,"threads_started":1}
I20260809 02:21:12.498703 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.470765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.1.81.193:39451)
0809 02:21:12.471569 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.471583 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.472223 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.472764 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.472767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.473339 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.474033 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.474048 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.475179 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.475182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.476628 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.476640 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.477145 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.477156 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.477282 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.477871 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.477886 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.492313 (+ 14427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.494465 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.494471 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.494487 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.494830 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.495149 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.495152 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.495154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.495333 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.495852 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.495860 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.496260 (+ 400us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.496466 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.498547 (+ 2081us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"mutex_wait_us":2137,"spinlock_wait_cycles":45184,"thread_start_us":115,"threads_started":1}
I20260809 02:21:12.499378 11971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.471703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:42625 (local address 127.1.81.252:42659)
0809 02:21:12.472048 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.472053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.472068 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:21:12.472427 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.472431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.472492 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.472575 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.474210 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.474988 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.476559 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.476851 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.476953 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.492535 (+ 15582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.492538 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.492541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.492571 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.494655 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.495115 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.495118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.495120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.495211 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.495485 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.495488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.495490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.495699 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.495773 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.499098 (+ 3325us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.499231 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":98,"threads_started":1}
I20260809 02:21:12.500402 11961 heartbeater.cc:347] Connected to a master server at 127.1.81.252:42659
I20260809 02:21:12.500432 11963 heartbeater.cc:347] Connected to a master server at 127.1.81.253:33301
I20260809 02:21:12.500661 11961 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.500662 11963 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.501297 11963 heartbeater.cc:511] Master 127.1.81.253:33301 requested a full tablet report, sending...
I20260809 02:21:12.503383 11383 ts_manager.cc:194] Registered new tserver with Master: 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295)
I20260809 02:21:12.504102 11961 heartbeater.cc:511] Master 127.1.81.252:42659 requested a full tablet report, sending...
I20260809 02:21:12.505116 11646 ts_manager.cc:194] Registered new tserver with Master: 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295)
I20260809 02:21:12.511473 11967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.470746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:53283)
0809 02:21:12.471215 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.471264 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.472223 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.472773 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.472776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.473326 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.474025 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.474048 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.475179 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.475182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.476628 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.476640 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.477272 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.477275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.477352 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.478007 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.478020 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.493052 (+ 15032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.510049 (+ 16997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.510053 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.510055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.510247 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.510524 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.510527 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.510529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.510617 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.510977 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.510980 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.511071 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.511151 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.511295 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":285,"spinlock_wait_cycles":5376,"thread_start_us":115,"threads_started":1}
I20260809 02:21:12.511482 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.470350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:53283 (local address 127.1.81.254:42057)
0809 02:21:12.470474 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.470479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.471378 (+ 899us) server_negotiation.cc:407] Connection header received
0809 02:21:12.472451 (+ 1073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.472454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.472515 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.472569 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.474193 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.475007 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.476744 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.477047 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.477137 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.508438 (+ 31301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.508442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.508444 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.508474 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.509933 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.510352 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.510355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.510356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.510439 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.510706 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.510709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.510710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.510885 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.510972 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.511233 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.511345 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:21:12.512132 11962 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42057
I20260809 02:21:12.512218 11962 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.512387 11962 heartbeater.cc:511] Master 127.1.81.254:42057 requested a full tablet report, sending...
I20260809 02:21:12.513090 10466 ts_manager.cc:194] Re-registered known tserver with Master: 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295)
I20260809 02:21:12.513634 10466 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:53283
I20260809 02:21:12.516840 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:34229
--local_ip_for_outbound_sockets=127.1.81.194
--tserver_master_addrs=127.1.81.254:42057
--webserver_port=37071
--webserver_interface=127.1.81.194
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab
--principal=oryx/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301,127.1.81.252:42659 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:12.625519 11972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:12.625743 11972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:12.625783 11972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:12.629644 11972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:12.629691 11972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:12.629757 11972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:12.634738 11972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab
--principal=oryx/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:34229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=37071
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301,127.1.81.252:42659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:12.635639 11972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:12.636559 11972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:21:12.645800 11972 server_base.cc:1034] running on GCE node
W20260809 02:21:12.645819 11978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.645754 11979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.645753 11982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:12.646293 11972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:12.646847 11972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:12.647984 11972 hybrid_clock.cc:648] HybridClock initialized: now 1786242072647953 us; error 48 us; skew 500 ppm
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:12.650624 11972 init.cc:377] Logged in from keytab as oryx/127.1.81.194@KRBTEST.COM (short username oryx)
I20260809 02:21:12.651418 11972 webserver.cc:460] Webserver started at http://127.1.81.194:37071/ using document root <none> and password file <none>
I20260809 02:21:12.651973 11972 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:12.652063 11972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:12.655488 11972 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 02:21:12.657456 11996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.658553 11972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:12.658659 11972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "c51def44e77446bb91eda8c56b87b204"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "7961852723897ac7c1135b22c52f64c6"
server_key_iv: "a38416550ca29fe0722e84a53ab12796"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.659152 11972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:12.668329 11972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:12.668553 11151 heartbeater.cc:503] Master 127.1.81.254:42057 was elected leader, sending a full tablet report...
I20260809 02:21:12.671067 11972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:12.671219 11972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:12.671689 11972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:12.672478 11972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:12.672525 11972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.672561 11972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:12.672580 11972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.681095 11972 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:34229
I20260809 02:21:12.681121 12164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:34229 every 8 connection(s)
I20260809 02:21:12.681979 11972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:12.682653 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 11972
I20260809 02:21:12.682847 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 10963
I20260809 02:21:12.696158 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:39443
--local_ip_for_outbound_sockets=127.1.81.195
--tserver_master_addrs=127.1.81.254:42057
--webserver_port=35223
--webserver_interface=127.1.81.195
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab
--principal=oryx/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301,127.1.81.252:42659 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.253@KRBTEST.COM
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.252@KRBTEST.COM
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:12.702127 11971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.688133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:58509 (local address 127.1.81.252:42659)
0809 02:21:12.688378 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.688383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.688854 (+ 471us) server_negotiation.cc:407] Connection header received
0809 02:21:12.689439 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.689442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.689493 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.689543 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.691462 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.692316 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694100 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.694447 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694518 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.698681 (+ 4163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.698685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.698687 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.698715 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.700205 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.700726 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.700730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.700731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.700823 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.701143 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.701146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.701148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.701363 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.701437 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.701824 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.701962 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260809 02:21:12.702128 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.687986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:38857 (local address 127.1.81.253:33301)
0809 02:21:12.688277 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.688281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.688411 (+ 130us) server_negotiation.cc:407] Connection header received
0809 02:21:12.689437 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.689440 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.689493 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.689542 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.691458 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.692254 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694087 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.694397 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694467 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.697682 (+ 3215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.697686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.697688 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.697714 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.699274 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.699935 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.699940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.699941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.700038 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.700454 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.700457 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.700459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.700693 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.700883 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.701850 (+ 967us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.701968 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205}
I20260809 02:21:12.702816 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.683567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:50079 (local address 127.1.81.254:42057)
0809 02:21:12.688181 (+ 4614us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.688187 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.688274 (+ 87us) server_negotiation.cc:407] Connection header received
0809 02:21:12.689439 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.689442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.689493 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.689543 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.691462 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.692319 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694100 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.694447 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694518 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.698865 (+ 4347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.698868 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.698871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.698900 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.700928 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.701379 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.701382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.701384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.701471 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.701845 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.701849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.701850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.702049 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.702133 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.702570 (+ 437us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.702677 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4524}
I20260809 02:21:12.703751 12173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.687760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.1.81.194:58509)
0809 02:21:12.688771 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.688782 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.689209 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.689918 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.689927 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.690534 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.691300 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.691318 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.692457 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.692460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.693965 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.693976 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.694673 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.694978 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.695878 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.695892 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.698515 (+ 2623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.700326 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.700329 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.700331 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.700585 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.700942 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.700945 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.700946 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.701036 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.701514 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.701517 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.701611 (+ 94us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.702266 (+ 655us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.703049 (+ 783us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":959,"mutex_wait_us":758,"spinlock_wait_cycles":16256,"thread_start_us":190,"threads_started":1}
I20260809 02:21:12.704020 12171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.684018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:50079)
0809 02:21:12.688119 (+ 4101us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.688183 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.689209 (+ 1026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.689918 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.689927 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.690534 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.691303 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.691318 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.692457 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.692460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.693965 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.693976 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.694673 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.694969 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.696553 (+ 1584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.696568 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.698706 (+ 2138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.701029 (+ 2323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.701032 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.701034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.701270 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.701564 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.701567 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.701569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.701735 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.702194 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.702197 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.702302 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.702398 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.702800 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3896,"mutex_wait_us":559,"spinlock_wait_cycles":76288,"thread_start_us":1174,"threads_started":1}
I20260809 02:21:12.703748 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.684019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.1.81.194:38857)
0809 02:21:12.688328 (+ 4309us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.688340 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.689210 (+ 870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.689919 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.689926 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.690540 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.691296 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.691316 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.692440 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.692443 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.693956 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.693967 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.694672 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.694676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.694998 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.695699 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.695719 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.697458 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.699408 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.699413 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.699426 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.699789 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.700148 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.700151 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.700153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.700337 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.700943 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.700949 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.701230 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.701406 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.702672 (+ 1266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4232,"mutex_wait_us":2222,"spinlock_wait_cycles":67840,"thread_start_us":1143,"threads_started":1}
I20260809 02:21:12.705118 12166 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42057
I20260809 02:21:12.705114 12165 heartbeater.cc:347] Connected to a master server at 127.1.81.252:42659
I20260809 02:21:12.705399 12167 heartbeater.cc:347] Connected to a master server at 127.1.81.253:33301
I20260809 02:21:12.705384 12165 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.705385 12166 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.705476 12167 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.706015 12167 heartbeater.cc:511] Master 127.1.81.253:33301 requested a full tablet report, sending...
I20260809 02:21:12.706017 12165 heartbeater.cc:511] Master 127.1.81.252:42659 requested a full tablet report, sending...
I20260809 02:21:12.706015 12166 heartbeater.cc:511] Master 127.1.81.254:42057 requested a full tablet report, sending...
I20260809 02:21:12.707119 11383 ts_manager.cc:194] Registered new tserver with Master: c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229)
I20260809 02:21:12.707173 11646 ts_manager.cc:194] Registered new tserver with Master: c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229)
I20260809 02:21:12.707530 10466 ts_manager.cc:194] Re-registered known tserver with Master: c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229)
I20260809 02:21:12.708230 10466 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:50079
I20260809 02:21:12.744782 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.741318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.0.0.1:58398)
0809 02:21:12.741441 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.741455 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.741527 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.741758 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.741760 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.741772 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:12.741844 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.741848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.742805 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.742806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.743512 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.743519 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.744404 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.744408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.744488 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.744529 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.744583 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.744665 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 02:21:12.744783 11971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.741404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58398 (local address 127.1.81.252:42659)
0809 02:21:12.741519 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.741523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.741540 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:21:12.741590 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.741593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.741651 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.741755 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:12.741933 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.742716 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.743621 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.744301 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.744410 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.744553 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.744597 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.744661 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:21:12.745422 11677 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 02:21:12.745828 11726 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19feb45cd9234b7eb25847b3e655e9f6. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.745970 11726 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: This master's current role is: LEARNER
W20260809 02:21:12.810243 12174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:12.810470 12174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:12.810516 12174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:12.814414 12174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:12.814459 12174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:12.814527 12174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:12.819505 12174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab
--principal=oryx/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:39443
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=35223
--tserver_master_addrs=127.1.81.254:42057,127.1.81.253:33301,127.1.81.252:42659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:12.820463 12174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:12.821408 12174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:12.830621 12182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.830613 12183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:12.830612 12186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:12.830952 12174 server_base.cc:1034] running on GCE node
I20260809 02:21:12.831341 12174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:12.831990 12174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:12.833149 12174 hybrid_clock.cc:648] HybridClock initialized: now 1786242072833129 us; error 29 us; skew 500 ppm
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:12.835681 12174 init.cc:377] Logged in from keytab as oryx/127.1.81.195@KRBTEST.COM (short username oryx)
I20260809 02:21:12.836484 12174 webserver.cc:460] Webserver started at http://127.1.81.195:35223/ using document root <none> and password file <none>
I20260809 02:21:12.836989 12174 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:12.837062 12174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:12.840684 12174 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260809 02:21:12.842576 12200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.843664 12174 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:21:12.843775 12174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "715111cd7bee4c83ba4ab83b58c0cef9"
format_stamp: "Formatted at 2026-08-09 02:21:11 on dist-test-slave-jlzn"
server_key: "797506f701440c590fcc02d453a53147"
server_key_iv: "866ddd6fbe860e4cfb091b263403f7fa"
server_key_version: "encryptionkey@0"
I20260809 02:21:12.844280 12174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:12.855261 12174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:12.858114 12174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:12.858249 12174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:12.858722 12174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:12.859486 12174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:12.859532 12174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.859567 12174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:12.859586 12174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:12.869377 12174 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:39443
I20260809 02:21:12.870020 12366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:39443 every 8 connection(s)
I20260809 02:21:12.870437 12174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:12.873095 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 12174
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.253@KRBTEST.COM
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.252@KRBTEST.COM
Aug 09 02:21:12 dist-test-slave-jlzn krb5kdc[10410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242072, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:12.889256 11971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.875263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:41797 (local address 127.1.81.252:42659)
0809 02:21:12.875401 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.875405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.875418 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:12.875462 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.875465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.875510 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.875580 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.877260 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.878029 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.880129 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.880417 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.880489 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.885047 (+ 4558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.885051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.885054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.885079 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.886871 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.887470 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.887473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.887475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.887570 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.888046 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.888050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.888052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.888266 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.888336 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.888975 (+ 639us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.889099 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:21:12.889510 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.874142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:39575 (local address 127.1.81.254:42057)
0809 02:21:12.874253 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.874258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.874849 (+ 591us) server_negotiation.cc:407] Connection header received
0809 02:21:12.875004 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.875008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.875065 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.875121 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.878332 (+ 3211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.879105 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.880604 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.880918 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.881018 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.885545 (+ 4527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.885549 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.885551 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.885578 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.887448 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.888252 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.888255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.888257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.888342 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.888640 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.888643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.888644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.888829 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.888902 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.889247 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.889359 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":31}
I20260809 02:21:12.890175 12390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.875753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58414 (local address 127.1.81.252:42659)
0809 02:21:12.880333 (+ 4580us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.880346 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.880356 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:21:12.880386 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.880389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.880430 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.880503 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.881438 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.882199 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.883272 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.883593 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.883685 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.886382 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.886386 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.886389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.886414 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.888241 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.888717 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.888721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.888722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.888806 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.889099 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.889102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.889104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.889287 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.889399 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.889907 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.890016 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4515,"thread_start_us":109,"threads_started":1}
I20260809 02:21:12.890882 12383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.875289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36358 (local address 127.1.81.254:42057)
0809 02:21:12.876319 (+ 1030us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.876323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.876335 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:12.876373 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.876376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.876418 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.877410 (+ 992us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.877514 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.878276 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.879770 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.880109 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.883047 (+ 2938us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.883167 (+ 120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.883171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.883173 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.883192 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.885070 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.885974 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.885977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.885979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.886071 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.887670 (+ 1599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.887673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.887675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.887915 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.889218 (+ 1303us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.889275 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.890729 (+ 1454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1970,"server-negotiator.queue_time_us":955,"thread_start_us":60,"threads_started":1}
I20260809 02:21:12.891165 12386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.875136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:36491 (local address 127.1.81.253:33301)
0809 02:21:12.876160 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.876164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.876178 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:21:12.876221 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.876223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.876271 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.876355 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.876998 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.877817 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.879500 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.879912 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.884698 (+ 4786us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.884809 (+ 111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.884812 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.884814 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.884832 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.887460 (+ 2628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.889744 (+ 2284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.889747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.889749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.889829 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.890149 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.890152 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.890154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.890355 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.890803 (+ 448us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.890875 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.890988 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":170,"server-negotiator.queue_time_us":933,"thread_start_us":73,"threads_started":1}
I20260809 02:21:12.891206 12375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.872805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.1.81.195:36491)
0809 02:21:12.874453 (+ 1648us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.874464 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.874539 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.876420 (+ 1881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.876423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.876612 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.876859 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.876874 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.877996 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.877999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.879363 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.879374 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.880070 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.880074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.880268 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.880904 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.880925 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.884534 (+ 3609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.887567 (+ 3033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.887570 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.887572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.888112 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.889931 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.889935 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.889937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.890031 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.890462 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.890465 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.890543 (+ 78us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.890617 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.890728 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1569,"mutex_wait_us":25,"spinlock_wait_cycles":34816,"thread_start_us":120,"threads_started":1}
I20260809 02:21:12.891426 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.875136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.1.81.253:33301)
0809 02:21:12.875283 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.875287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.876341 (+ 1054us) server_negotiation.cc:407] Connection header received
0809 02:21:12.877136 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.877139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.877183 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.877228 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:12.878085 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.878810 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.881109 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.881416 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.881492 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.884190 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:12.884194 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:12.884196 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:12.884222 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:12.886236 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.888266 (+ 2030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.888269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.888271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.888342 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:12.889550 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:12.889554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:12.889556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:12.889779 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:12.889885 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.891197 (+ 1312us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.891301 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:21:12.891750 12374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.873829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:39575)
0809 02:21:12.874756 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.874768 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.874873 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.875651 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.875660 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.876229 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.876862 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.876878 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.879319 (+ 2441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.879322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.880146 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.880154 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.881541 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.881544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.881728 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.882511 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.882526 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.885408 (+ 2882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.887567 (+ 2159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.887570 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.887572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.887836 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.888453 (+ 617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.888456 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.888457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.888537 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.888962 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.888965 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.889053 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.889633 (+ 580us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.891529 (+ 1896us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":854,"mutex_wait_us":1759,"spinlock_wait_cycles":1792,"thread_start_us":85,"threads_started":1}
I20260809 02:21:12.890725 12373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.872806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.1.81.195:41797)
0809 02:21:12.873340 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.873392 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.874352 (+ 960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.875968 (+ 1616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.875972 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.876996 (+ 1024us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:12.877123 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.877130 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.878171 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.878174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.879994 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.880005 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.881195 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.881198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.881294 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.881956 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:12.881969 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:12.884890 (+ 2921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:12.886994 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.886999 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.887013 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.887353 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.887687 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:12.887690 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:12.887692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:12.887930 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:12.888403 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:12.888410 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:12.888695 (+ 285us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.889451 (+ 756us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.889773 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":909,"thread_start_us":145,"threads_started":1}
I20260809 02:21:12.892446 12367 heartbeater.cc:347] Connected to a master server at 127.1.81.252:42659
I20260809 02:21:12.892629 12369 heartbeater.cc:347] Connected to a master server at 127.1.81.254:42057
I20260809 02:21:12.892688 12367 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.892694 12369 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.893103 12370 heartbeater.cc:347] Connected to a master server at 127.1.81.253:33301
I20260809 02:21:12.893174 12370 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:12.893253 12369 heartbeater.cc:511] Master 127.1.81.254:42057 requested a full tablet report, sending...
I20260809 02:21:12.893308 12370 heartbeater.cc:511] Master 127.1.81.253:33301 requested a full tablet report, sending...
I20260809 02:21:12.893702 12367 heartbeater.cc:511] Master 127.1.81.252:42659 requested a full tablet report, sending...
I20260809 02:21:12.894312 10466 ts_manager.cc:194] Re-registered known tserver with Master: 715111cd7bee4c83ba4ab83b58c0cef9 (127.1.81.195:39443)
I20260809 02:21:12.894356 11383 ts_manager.cc:194] Registered new tserver with Master: 715111cd7bee4c83ba4ab83b58c0cef9 (127.1.81.195:39443)
I20260809 02:21:12.894753 11646 ts_manager.cc:194] Registered new tserver with Master: 715111cd7bee4c83ba4ab83b58c0cef9 (127.1.81.195:39443)
I20260809 02:21:12.894970 10466 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:39575
I20260809 02:21:12.895224 10465 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36358:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:12.898169 10465 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:12.900491 11608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: NON_VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: true } } }
I20260809 02:21:12.900632 11608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:12.904294 11608 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: attempting to promote NON_VOTER ca5f4539f8944cc7837ef80855452f3c to VOTER
I20260809 02:21:12.904646 11608 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } }
I20260809 02:21:12.905755 11677 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 LEARNER]: Refusing update from remote peer 19feb45cd9234b7eb25847b3e655e9f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 02:21:12.905933 11402 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Refusing update from remote peer 19feb45cd9234b7eb25847b3e655e9f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 02:21:12.906163 12393 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 02:21:12.906440 12393 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 02:21:12.907996 12393 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, ca5f4539f8944cc7837ef80855452f3c (127.1.81.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:12.908532 11402 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, ca5f4539f8944cc7837ef80855452f3c (127.1.81.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:12.909257 11608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:12.909374 11608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:12.909789 12393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:12.910077 12393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:12.909943 12397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:12.910235 12397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:12.910156 11677 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, ca5f4539f8944cc7837ef80855452f3c (127.1.81.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:12.910717 12410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:12.910835 12410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:12.914024 11726 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19feb45cd9234b7eb25847b3e655e9f6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:12.914149 11726 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:12.916922 12412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.911703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:43295 (local address 127.0.0.1:57418)
0809 02:21:12.911944 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.911959 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.912046 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.912995 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.912999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.913016 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:12.913110 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.913117 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.914468 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.914471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.915405 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.915418 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.916519 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.916523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.916620 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.916644 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.916725 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.916788 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"spinlock_wait_cycles":3712,"thread_start_us":627,"threads_started":1}
I20260809 02:21:12.916996 12413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.912054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57418 (local address 127.1.81.193:43295)
0809 02:21:12.912513 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.912532 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.912554 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:21:12.912629 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.912634 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.912846 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.913012 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:12.913250 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.914342 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.915529 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.916414 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.916515 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.916655 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.916755 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.916851 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":121,"threads_started":1}
I20260809 02:21:12.919700 11844 tablet_service.cc:1467] Processing CreateTablet for tablet 5af3ce0b93f84696bce92c47c9d42c29 (DEFAULT_TABLE table=test-table [id=d050b701345c42d1b92ec8e22580f348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:12.920630 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.911247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:34229 (local address 127.0.0.1:58194)
0809 02:21:12.911944 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.911959 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.912046 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.916923 (+ 4877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.916927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.916945 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:12.917021 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.917027 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.918468 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.918470 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.919212 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.919223 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.920363 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.920365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.920429 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.920447 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.920496 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.920541 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"spinlock_wait_cycles":6144}
I20260809 02:21:12.920766 12411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.911440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58194 (local address 127.1.81.194:34229)
0809 02:21:12.916468 (+ 5028us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.916480 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.916503 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:21:12.916575 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.916580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.916772 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.917253 (+ 481us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:12.917361 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.918348 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.919333 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.920217 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.920359 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.920491 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.920540 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.920620 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4919,"thread_start_us":135,"threads_started":1}
I20260809 02:21:12.920861 11844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af3ce0b93f84696bce92c47c9d42c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:12.923437 12067 tablet_service.cc:1467] Processing CreateTablet for tablet 5af3ce0b93f84696bce92c47c9d42c29 (DEFAULT_TABLE table=test-table [id=d050b701345c42d1b92ec8e22580f348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:12.924443 12067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af3ce0b93f84696bce92c47c9d42c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:12.924902 12414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.912265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:39443 (local address 127.0.0.1:39750)
0809 02:21:12.913883 (+ 1618us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:12.913896 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:12.914039 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:12.914665 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:12.914668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:12.914688 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:12.914775 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.914782 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.916275 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.916278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.917469 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:12.917479 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.924452 (+ 6973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.924456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:12.924627 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.924651 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:21:12.924716 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:21:12.924782 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1556,"thread_start_us":97,"threads_started":1}
I20260809 02:21:12.924969 12416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:12.912429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39750 (local address 127.1.81.195:39443)
0809 02:21:12.912766 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:12.912776 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:12.914130 (+ 1354us) server_negotiation.cc:407] Connection header received
0809 02:21:12.914203 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:12.914208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:12.914384 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:12.914521 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:12.914900 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.916182 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.917593 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:12.924339 (+ 6746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:12.924436 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:12.924563 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:12.924757 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 02:21:12.924846 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":152,"threads_started":1}
I20260809 02:21:12.927234 12273 tablet_service.cc:1467] Processing CreateTablet for tablet 5af3ce0b93f84696bce92c47c9d42c29 (DEFAULT_TABLE table=test-table [id=d050b701345c42d1b92ec8e22580f348]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:12.928148 12273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af3ce0b93f84696bce92c47c9d42c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:12.929399 12420 tablet_bootstrap.cc:492] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Bootstrap starting.
I20260809 02:21:12.932096 12420 tablet_bootstrap.cc:654] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:12.932302 12421 tablet_bootstrap.cc:492] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Bootstrap starting.
I20260809 02:21:12.933362 12420 log.cc:824] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:12.934514 12421 tablet_bootstrap.cc:654] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:12.935148 12421 log.cc:824] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:12.935567 12420 tablet_bootstrap.cc:492] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: No bootstrap required, opened a new log
I20260809 02:21:12.935773 12420 ts_tablet_manager.cc:1397] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 02:21:12.936426 12424 tablet_bootstrap.cc:492] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Bootstrap starting.
I20260809 02:21:12.937014 12421 tablet_bootstrap.cc:492] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: No bootstrap required, opened a new log
I20260809 02:21:12.937208 12421 ts_tablet_manager.cc:1397] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:21:12.938629 12424 tablet_bootstrap.cc:654] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:12.939540 12424 log.cc:824] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:12.940665 12420 raft_consensus.cc:348] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:12.940858 12420 raft_consensus.cc:374] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:12.940919 12420 raft_consensus.cc:729] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 333629d0e916424a9eb4e6768fca6b51, State: Initialized, Role: FOLLOWER
I20260809 02:21:12.941309 12420 consensus_queue.cc:260] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:12.941603 12424 tablet_bootstrap.cc:492] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: No bootstrap required, opened a new log
I20260809 02:21:12.941788 12424 ts_tablet_manager.cc:1397] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:21:12.942003 11962 heartbeater.cc:503] Master 127.1.81.254:42057 was elected leader, sending a full tablet report...
I20260809 02:21:12.942207 12421 raft_consensus.cc:348] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:12.942437 12421 raft_consensus.cc:374] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:12.942489 12421 raft_consensus.cc:729] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51def44e77446bb91eda8c56b87b204, State: Initialized, Role: FOLLOWER
I20260809 02:21:12.942881 12421 consensus_queue.cc:260] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:12.943790 12421 ts_tablet_manager.cc:1428] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 02:21:12.944123 12166 heartbeater.cc:503] Master 127.1.81.254:42057 was elected leader, sending a full tablet report...
I20260809 02:21:12.944715 12420 ts_tablet_manager.cc:1428] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260809 02:21:12.949676 12424 raft_consensus.cc:348] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:12.949889 12424 raft_consensus.cc:374] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:12.949934 12424 raft_consensus.cc:729] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 715111cd7bee4c83ba4ab83b58c0cef9, State: Initialized, Role: FOLLOWER
I20260809 02:21:12.950223 12424 consensus_queue.cc:260] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:12.950824 12369 heartbeater.cc:503] Master 127.1.81.254:42057 was elected leader, sending a full tablet report...
I20260809 02:21:12.950977 12424 ts_tablet_manager.cc:1428] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
W20260809 02:21:12.970512 11966 tablet.cc:2369] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:21:13.121863 12372 tablet.cc:2369] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:13.184039 12433 raft_consensus.cc:482] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:13.184321 12433 raft_consensus.cc:504] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:13.185604 12433 leader_election.cc:288] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229), 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295)
W20260809 02:21:13.186229 12168 tablet.cc:2369] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:13.190559 12413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.185977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:43391 (local address 127.1.81.193:43295)
0809 02:21:13.186192 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:13.186197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:13.186214 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:21:13.186329 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:13.186332 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:13.186381 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:13.186444 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:13.186884 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.187684 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.189301 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.189918 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.190038 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.190093 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:13.190348 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 02:21:13.190424 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260809 02:21:13.190559 12411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.186029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:35799 (local address 127.1.81.194:34229)
0809 02:21:13.186206 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:13.186211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:13.186224 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:13.186276 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:13.186279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:13.186333 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:13.186403 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:13.186884 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.187684 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.189301 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.189921 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.190038 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.190093 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:13.190348 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 02:21:13.190424 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 02:21:13.190579 12374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.185949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:43295 (local address 127.1.81.195:43391)
0809 02:21:13.186131 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:13.186144 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:13.186230 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:13.186539 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:13.186541 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:13.186554 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:13.186748 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:13.186758 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.187787 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.187795 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:13.189185 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:13.189196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.190034 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.190038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:13.190212 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.190250 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 02:21:13.190327 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:21:13.190424 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":156,"spinlock_wait_cycles":768}
I20260809 02:21:13.190595 12373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.185811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:34229 (local address 127.1.81.195:35799)
0809 02:21:13.185926 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:13.185942 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:13.186039 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:13.186525 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:13.186529 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:13.186547 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:13.186748 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:13.186758 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.187787 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.187790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:13.189184 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:13.189196 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.190034 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.190038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:13.190209 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.190260 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 02:21:13.190327 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:21:13.190424 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":104}
I20260809 02:21:13.191191 11876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af3ce0b93f84696bce92c47c9d42c29" candidate_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "333629d0e916424a9eb4e6768fca6b51" is_pre_election: true
I20260809 02:21:13.191220 12092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af3ce0b93f84696bce92c47c9d42c29" candidate_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51def44e77446bb91eda8c56b87b204" is_pre_election: true
I20260809 02:21:13.191463 11876 raft_consensus.cc:2454] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 715111cd7bee4c83ba4ab83b58c0cef9 in term 0.
I20260809 02:21:13.191473 12092 raft_consensus.cc:2454] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 715111cd7bee4c83ba4ab83b58c0cef9 in term 0.
I20260809 02:21:13.191932 12205 leader_election.cc:302] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 715111cd7bee4c83ba4ab83b58c0cef9, c51def44e77446bb91eda8c56b87b204; no voters:
I20260809 02:21:13.192204 12433 raft_consensus.cc:2781] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:13.192296 12433 raft_consensus.cc:482] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:13.192346 12433 raft_consensus.cc:3037] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:13.193727 12433 raft_consensus.cc:504] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:13.194032 12433 leader_election.cc:288] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [CANDIDATE]: Term 1 election: Requested vote from peers c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229), 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295)
I20260809 02:21:13.194360 12092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af3ce0b93f84696bce92c47c9d42c29" candidate_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51def44e77446bb91eda8c56b87b204"
I20260809 02:21:13.194373 11876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af3ce0b93f84696bce92c47c9d42c29" candidate_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "333629d0e916424a9eb4e6768fca6b51"
I20260809 02:21:13.194487 12092 raft_consensus.cc:3037] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:13.194487 11876 raft_consensus.cc:3037] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:13.195832 11876 raft_consensus.cc:2454] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 715111cd7bee4c83ba4ab83b58c0cef9 in term 1.
I20260809 02:21:13.195986 12092 raft_consensus.cc:2454] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 715111cd7bee4c83ba4ab83b58c0cef9 in term 1.
I20260809 02:21:13.196106 12202 leader_election.cc:302] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 333629d0e916424a9eb4e6768fca6b51, 715111cd7bee4c83ba4ab83b58c0cef9; no voters:
I20260809 02:21:13.196278 12433 raft_consensus.cc:2781] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:13.196503 12433 raft_consensus.cc:686] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 LEADER]: Becoming Leader. State: Replica: 715111cd7bee4c83ba4ab83b58c0cef9, State: Running, Role: LEADER
I20260809 02:21:13.196830 12433 consensus_queue.cc:237] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:13.200019 10465 catalog_manager.cc:5495] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 715111cd7bee4c83ba4ab83b58c0cef9 (127.1.81.195). New cstate: current_term: 1 leader_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } health_report { overall_health: UNKNOWN } } }
I20260809 02:21:13.281658 12416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.278339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39758 (local address 127.1.81.195:39443)
0809 02:21:13.278464 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:13.278468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:13.278484 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:21:13.278557 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:13.278559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:13.278614 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:13.278705 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:13.278897 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.279378 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.280251 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.280469 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.280577 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.280882 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:13.281350 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:13.281436 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:13.281487 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 02:21:13.281536 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:21:13.287245 11876 raft_consensus.cc:1261] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 1 FOLLOWER]: Refusing update from remote peer 715111cd7bee4c83ba4ab83b58c0cef9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:13.287245 12092 raft_consensus.cc:1261] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 1 FOLLOWER]: Refusing update from remote peer 715111cd7bee4c83ba4ab83b58c0cef9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:13.287951 12433 consensus_queue.cc:1035] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:13.288199 12434 consensus_queue.cc:1035] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:13.298105 12439 mvcc.cc:205] Tried to move back new op lower bound from 7316447532177580032 to 7316447531816456192. Current Snapshot: MvccSnapshot[applied={T|T < 7316447532177580032}]
I20260809 02:21:13.305819 10465 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36358:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:13.305979 10465 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36358:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:13.310747 10465 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 19feb45cd9234b7eb25847b3e655e9f6: Sending DeleteTablet for 3 replicas of tablet 5af3ce0b93f84696bce92c47c9d42c29
I20260809 02:21:13.311374 12067 tablet_service.cc:1514] Processing DeleteTablet for tablet 5af3ce0b93f84696bce92c47c9d42c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:13 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58194
I20260809 02:21:13.311601 12273 tablet_service.cc:1514] Processing DeleteTablet for tablet 5af3ce0b93f84696bce92c47c9d42c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:13 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:39750
I20260809 02:21:13.312171 11844 tablet_service.cc:1514] Processing DeleteTablet for tablet 5af3ce0b93f84696bce92c47c9d42c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:13 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:57418
I20260809 02:21:13.312888 12459 tablet_replica.cc:330] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: stopping tablet replica
I20260809 02:21:13.313186 12459 raft_consensus.cc:2229] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:13.313428 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 10425
I20260809 02:21:13.313472 12454 tablet_replica.cc:330] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: stopping tablet replica
I20260809 02:21:13.319047 12458 tablet_replica.cc:330] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: stopping tablet replica
I20260809 02:21:13.319344 12458 raft_consensus.cc:2229] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:13.319505 12454 raft_consensus.cc:2229] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:13.319667 12458 raft_consensus.cc:2258] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:13.313509 12459 raft_consensus.cc:2258] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:13.319890 12454 raft_consensus.cc:2258] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:13.321576 12458 ts_tablet_manager.cc:1905] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:13.322558 12459 ts_tablet_manager.cc:1905] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:13.324470 12458 ts_tablet_manager.cc:1918] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:13.324568 12458 log.cc:1196] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/5af3ce0b93f84696bce92c47c9d42c29
I20260809 02:21:13.324893 12458 ts_tablet_manager.cc:1939] T 5af3ce0b93f84696bce92c47c9d42c29 P 333629d0e916424a9eb4e6768fca6b51: Deleting consensus metadata
I20260809 02:21:13.325557 12459 ts_tablet_manager.cc:1918] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:13.325664 12459 log.cc:1196] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/5af3ce0b93f84696bce92c47c9d42c29
I20260809 02:21:13.326021 12459 ts_tablet_manager.cc:1939] T 5af3ce0b93f84696bce92c47c9d42c29 P 715111cd7bee4c83ba4ab83b58c0cef9: Deleting consensus metadata
I20260809 02:21:13.326550 12454 ts_tablet_manager.cc:1905] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:13.328589 12454 ts_tablet_manager.cc:1918] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:13.328676 12454 log.cc:1196] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/5af3ce0b93f84696bce92c47c9d42c29
I20260809 02:21:13.328917 12454 ts_tablet_manager.cc:1939] T 5af3ce0b93f84696bce92c47c9d42c29 P c51def44e77446bb91eda8c56b87b204: Deleting consensus metadata
W20260809 02:21:13.329312 12205 connection.cc:535] server connection from 127.0.0.1:39750 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 02:21:13.329630 11776 connection.cc:535] server connection from 127.0.0.1:57418 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 02:21:13.329842 12000 connection.cc:441] server connection from 127.0.0.1:58194 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58194 (request call id 1) could send its response
I20260809 02:21:13.342430 11971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.332721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58432 (local address 127.1.81.252:42659)
0809 02:21:13.332827 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:13.332831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:13.333407 (+ 576us) server_negotiation.cc:407] Connection header received
0809 02:21:13.333627 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:13.333631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:13.333686 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:13.333739 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:13.334711 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.335476 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.336882 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.337222 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.337287 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.338988 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:13.338992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:13.338994 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:13.339020 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:13.340567 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:13.341029 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:13.341032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:13.341034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:13.341126 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:13.341474 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:13.341478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:13.341480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:13.341697 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:13.341809 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:13.342163 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 02:21:13.342277 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:21:13.342639 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.313178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.1.81.253:33301)
0809 02:21:13.313281 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:13.313285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:13.332108 (+ 18823us) server_negotiation.cc:407] Connection header received
0809 02:21:13.332306 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:13.332309 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:13.332358 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:13.332407 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:13.333742 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.334541 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.335746 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.336166 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.336243 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.338515 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:13.338519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:13.338522 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:13.338564 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:13.340567 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:13.341346 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:13.341350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:13.341352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:13.341437 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:13.341737 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:13.341740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:13.341742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:13.341937 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:13.342029 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:13.342372 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 02:21:13.342485 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:21:13.343412 12386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.332374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44074 (local address 127.1.81.253:33301)
0809 02:21:13.332482 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:13.332486 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:13.333108 (+ 622us) server_negotiation.cc:407] Connection header received
0809 02:21:13.333227 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:13.333230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:13.333275 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:13.333343 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:13.334687 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.335465 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.336816 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.337148 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.337221 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.339136 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:13.339139 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:13.339142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:13.339166 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:13.341169 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:13.341609 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:13.341612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:13.341614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:13.341705 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:13.342018 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:13.342021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:13.342023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:13.342225 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:13.342327 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:13.343169 (+ 842us) server_negotiation.cc:299] Negotiation successful
0809 02:21:13.343282 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:13.351353 12390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:13.312567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58428 (local address 127.1.81.252:42659)
0809 02:21:13.312681 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:13.312685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:13.343893 (+ 31208us) server_negotiation.cc:407] Connection header received
0809 02:21:13.344043 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:13.344046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:13.344088 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:13.344133 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:13.344964 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.345497 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.346519 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:13.346762 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:13.346834 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:13.348229 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:13.348233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:13.348236 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:13.348262 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:13.349892 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:13.350248 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:13.350251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:13.350253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:13.350336 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:13.350535 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:13.350537 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:13.350539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:13.350734 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:13.350850 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:13.350978 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 02:21:13.351206 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:21:14.299466 12468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.299003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:55225)
0809 02:21:14.299251 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.299353 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":78,"threads_started":1}
W20260809 02:21:14.299867 12166 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:42057 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.300572 12469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.300172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:47309)
0809 02:21:14.300395 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.300484 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":65,"threads_started":1}
W20260809 02:21:14.300845 11962 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:42057 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.303506 12470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.303091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:47229)
0809 02:21:14.303314 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.303404 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":72,"threads_started":1}
W20260809 02:21:14.303819 12369 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:42057 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.811319 12471 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 19feb45cd9234b7eb25847b3e655e9f6)
I20260809 02:21:14.811412 12473 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 19feb45cd9234b7eb25847b3e655e9f6)
I20260809 02:21:14.811528 12471 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } }
I20260809 02:21:14.811610 12473 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } }
I20260809 02:21:14.812530 12473 leader_election.cc:288] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057), ca5f4539f8944cc7837ef80855452f3c (127.1.81.252:42659)
I20260809 02:21:14.812899 12471 leader_election.cc:288] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057), 2fbbbd0a5fa947d8bd9fd45a83503517 (127.1.81.253:33301)
I20260809 02:21:14.813185 12475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.812685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36876)
0809 02:21:14.812995 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.813080 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":77,"threads_started":1}
W20260809 02:21:14.813465 11634 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.813520 12478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.812706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36878)
0809 02:21:14.813355 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.813429 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":71,"threads_started":1}
W20260809 02:21:14.813644 11360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.814412 12475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.814183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36890)
0809 02:21:14.814291 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.814343 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 02:21:14.814584 11634 leader_election.cc:334] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057): Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.814778 12483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.814505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36898)
0809 02:21:14.814655 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.814708 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260809 02:21:14.814973 11360 leader_election.cc:334] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057): Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.817060 12479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.812818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.1.81.253:33301)
0809 02:21:14.813235 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:14.813240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:14.813255 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:21:14.813303 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:14.813306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:14.813355 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:14.813438 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:14.813798 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:14.814552 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:14.815983 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:14.816523 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:14.816619 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:14.816691 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:14.816874 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 02:21:14.816944 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":345,"thread_start_us":71,"threads_started":1}
I20260809 02:21:14.817075 12476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.812706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:33301 (local address 127.0.0.1:44080)
0809 02:21:14.813047 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.813060 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:14.813168 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:14.813565 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:14.813569 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:14.813587 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:14.813684 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:14.813690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:14.814664 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:14.814667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:14.815867 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:14.815877 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:14.816632 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:14.816636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:14.816730 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:14.816785 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 02:21:14.816849 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:21:14.816932 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":46,"thread_start_us":66,"threads_started":1}
I20260809 02:21:14.817521 11402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca5f4539f8944cc7837ef80855452f3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" is_pre_election: true
I20260809 02:21:14.817629 12478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.813308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42659 (local address 127.0.0.1:58446)
0809 02:21:14.813987 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.814001 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:14.814099 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:14.814435 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:14.814438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:14.814456 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:14.814533 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:14.814539 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:14.815561 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:14.815564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:14.816541 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:14.816553 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:14.817288 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:14.817292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:14.817378 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:14.817402 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:21:14.817476 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:21:14.817532 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":19,"thread_start_us":55,"threads_started":1}
I20260809 02:21:14.817711 12482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.813135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58446 (local address 127.1.81.252:42659)
0809 02:21:14.813555 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:14.813559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:14.814171 (+ 612us) server_negotiation.cc:407] Connection header received
0809 02:21:14.814219 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:14.814222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:14.814263 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:14.814337 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:14.814660 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:14.815462 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:14.816658 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:14.817084 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:14.817196 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:14.817253 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:14.817498 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 02:21:14.817577 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":354,"thread_start_us":57,"threads_started":1}
I20260809 02:21:14.817723 11402 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca5f4539f8944cc7837ef80855452f3c in term 1.
I20260809 02:21:14.818034 11633 leader_election.cc:302] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbbd0a5fa947d8bd9fd45a83503517, ca5f4539f8944cc7837ef80855452f3c; no voters: 19feb45cd9234b7eb25847b3e655e9f6
I20260809 02:21:14.818122 11677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ca5f4539f8944cc7837ef80855452f3c" is_pre_election: true
I20260809 02:21:14.818243 12471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 02:21:14.818337 11677 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbbbd0a5fa947d8bd9fd45a83503517 in term 1.
I20260809 02:21:14.818413 12471 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 19feb45cd9234b7eb25847b3e655e9f6)
I20260809 02:21:14.818475 12471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:21:14.818663 11360 leader_election.cc:302] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbbd0a5fa947d8bd9fd45a83503517, ca5f4539f8944cc7837ef80855452f3c; no voters: 19feb45cd9234b7eb25847b3e655e9f6
I20260809 02:21:14.818858 12473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 02:21:14.818919 12473 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 19feb45cd9234b7eb25847b3e655e9f6)
I20260809 02:21:14.818959 12473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:21:14.819778 12471 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } }
I20260809 02:21:14.820184 12471 leader_election.cc:288] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 2 election: Requested vote from peers 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057), 2fbbbd0a5fa947d8bd9fd45a83503517 (127.1.81.253:33301)
I20260809 02:21:14.820333 12473 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } }
I20260809 02:21:14.820490 12476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.820290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36908)
0809 02:21:14.820382 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.820433 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 02:21:14.820484 11402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca5f4539f8944cc7837ef80855452f3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517"
I20260809 02:21:14.820637 11402 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca5f4539f8944cc7837ef80855452f3c in current term 2: Already voted for candidate 2fbbbd0a5fa947d8bd9fd45a83503517 in this term.
I20260809 02:21:14.820714 12473 leader_election.cc:288] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [CANDIDATE]: Term 2 election: Requested vote from peers 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057), ca5f4539f8944cc7837ef80855452f3c (127.1.81.252:42659)
I20260809 02:21:14.821161 11677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ca5f4539f8944cc7837ef80855452f3c"
I20260809 02:21:14.821228 12478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.820818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36918)
0809 02:21:14.821114 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.821166 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227}
I20260809 02:21:14.821314 11677 raft_consensus.cc:2379] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fbbbd0a5fa947d8bd9fd45a83503517 in current term 2: Already voted for candidate ca5f4539f8944cc7837ef80855452f3c in this term.
I20260809 02:21:14.821345 12476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.821141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36922)
0809 02:21:14.821239 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.821290 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 02:21:14.821417 11634 leader_election.cc:334] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057): Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.821467 11634 leader_election.cc:302] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca5f4539f8944cc7837ef80855452f3c; no voters: 19feb45cd9234b7eb25847b3e655e9f6, 2fbbbd0a5fa947d8bd9fd45a83503517
I20260809 02:21:14.821589 12471 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 02:21:14.821990 12478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:14.821658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:36926)
0809 02:21:14.821901 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:14.821942 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191}
W20260809 02:21:14.822093 11360 leader_election.cc:334] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057): Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:14.822162 11360 leader_election.cc:302] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbbbd0a5fa947d8bd9fd45a83503517; no voters: 19feb45cd9234b7eb25847b3e655e9f6, ca5f4539f8944cc7837ef80855452f3c
I20260809 02:21:14.822274 12473 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 02:21:15.300907 12486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:15.300451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:53601)
0809 02:21:15.300719 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:15.300788 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":108,"threads_started":1}
I20260809 02:21:15.301774 12487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:15.301382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:34713)
0809 02:21:15.301625 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:15.301690 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":79,"threads_started":1}
I20260809 02:21:15.304711 12488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:15.304322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:34339)
0809 02:21:15.304554 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:15.304619 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":77,"threads_started":1}
I20260809 02:21:16.302317 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.301885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:56271)
0809 02:21:16.302118 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.302196 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":71,"threads_started":1}
I20260809 02:21:16.302731 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.302325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:42131)
0809 02:21:16.302555 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.302618 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":68,"threads_started":1}
I20260809 02:21:16.305752 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.305272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:44853)
0809 02:21:16.305605 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.305664 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":58,"threads_started":1}
I20260809 02:21:16.467237 12493 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:16.467360 12493 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } }
I20260809 02:21:16.467724 12493 leader_election.cc:288] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057), 2fbbbd0a5fa947d8bd9fd45a83503517 (127.1.81.253:33301)
I20260809 02:21:16.468173 11402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca5f4539f8944cc7837ef80855452f3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" is_pre_election: true
I20260809 02:21:16.468320 11402 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca5f4539f8944cc7837ef80855452f3c in term 2.
I20260809 02:21:16.468365 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.467904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:37198)
0809 02:21:16.468209 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.468271 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":85,"threads_started":1}
I20260809 02:21:16.468631 11633 leader_election.cc:302] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbbbd0a5fa947d8bd9fd45a83503517, ca5f4539f8944cc7837ef80855452f3c; no voters:
I20260809 02:21:16.468842 12493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 02:21:16.468935 12493 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:16.468989 12493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:21:16.469252 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.469028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:37212)
0809 02:21:16.469134 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.469187 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 02:21:16.469419 11634 leader_election.cc:334] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057): Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:16.470105 12493 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } }
I20260809 02:21:16.470408 12493 leader_election.cc:288] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 3 election: Requested vote from peers 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057), 2fbbbd0a5fa947d8bd9fd45a83503517 (127.1.81.253:33301)
I20260809 02:21:16.470745 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.470515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:37224)
0809 02:21:16.470625 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.470688 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 02:21:16.470767 11402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca5f4539f8944cc7837ef80855452f3c" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517"
I20260809 02:21:16.470887 11402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:21:16.471359 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.471168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:37226)
0809 02:21:16.471268 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.471313 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 02:21:16.471454 11634 leader_election.cc:334] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057): Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
I20260809 02:21:16.471947 11402 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca5f4539f8944cc7837ef80855452f3c in term 3.
I20260809 02:21:16.472220 11633 leader_election.cc:302] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbbbd0a5fa947d8bd9fd45a83503517, ca5f4539f8944cc7837ef80855452f3c; no voters: 19feb45cd9234b7eb25847b3e655e9f6
I20260809 02:21:16.472401 12493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:21:16.472585 12493 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [term 3 LEADER]: Becoming Leader. State: Replica: ca5f4539f8944cc7837ef80855452f3c, State: Running, Role: LEADER
I20260809 02:21:16.472867 12493 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } }
I20260809 02:21:16.473929 12496 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca5f4539f8944cc7837ef80855452f3c. Latest consensus state: current_term: 3 leader_uuid: "ca5f4539f8944cc7837ef80855452f3c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:16.474035 12496 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:16.474319 12500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:16.476866 12500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:16.477295 12500 catalog_manager.cc:1259] Loaded cluster ID: ad14096474904279972f1208db4b8c0f
I20260809 02:21:16.477344 12500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:16.477861 12500 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:16.478221 12500 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Loaded TSK: 0
I20260809 02:21:16.478837 12500 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:21:16.533077 11660 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58432:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:16.536064 11660 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:16.538794 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.538525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:37248)
0809 02:21:16.538664 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.538721 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 02:21:16.538893 11402 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [term 3 FOLLOWER]: Refusing update from remote peer ca5f4539f8944cc7837ef80855452f3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 02:21:16.539361 12496 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260809 02:21:16.539449 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.539236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.0.0.1:37260)
0809 02:21:16.539341 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.539390 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 02:21:16.539582 11634 consensus_peers.cc:487] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c -> Peer 19feb45cd9234b7eb25847b3e655e9f6 (127.1.81.254:42057): Couldn't send request to peer 19feb45cd9234b7eb25847b3e655e9f6. Status: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 02:21:16.540735 12502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca5f4539f8944cc7837ef80855452f3c. Latest consensus state: current_term: 3 leader_uuid: "ca5f4539f8944cc7837ef80855452f3c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:16.540863 12502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:16.541836 12493 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "ca5f4539f8944cc7837ef80855452f3c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:16.541944 12493 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:16.542372 12502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "ca5f4539f8944cc7837ef80855452f3c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "19feb45cd9234b7eb25847b3e655e9f6" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 42057 } } peers { permanent_uuid: "2fbbbd0a5fa947d8bd9fd45a83503517" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 33301 } attrs { promote: false } } peers { permanent_uuid: "ca5f4539f8944cc7837ef80855452f3c" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42659 } attrs { promote: false } } }
I20260809 02:21:16.544121 12502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbbbd0a5fa947d8bd9fd45a83503517 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:16.551786 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.547209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:34229 (local address 127.0.0.1:58196)
0809 02:21:16.547848 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.547861 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:16.547958 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:16.548233 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:16.548235 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:16.548251 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:16.548343 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:16.548349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.549370 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.549373 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:16.550617 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:16.550629 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.551409 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.551413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:16.551507 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:16.551530 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:21:16.551608 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:21:16.551676 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":48}
I20260809 02:21:16.551860 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.547331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58196 (local address 127.1.81.194:34229)
0809 02:21:16.547606 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:16.547611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:16.548018 (+ 407us) server_negotiation.cc:407] Connection header received
0809 02:21:16.548081 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:16.548084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:16.548143 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:16.548220 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:16.548471 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.549267 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.550760 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.551305 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.551397 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:16.551460 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:16.551637 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:21:16.551716 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":89,"threads_started":1}
I20260809 02:21:16.552286 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.547477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:39443 (local address 127.0.0.1:39764)
0809 02:21:16.548430 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.548442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:16.548546 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:16.548798 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:16.548801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:16.548819 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:16.548927 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:16.548933 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.549822 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.549825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:16.550884 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:16.550894 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.551924 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.551927 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:16.552002 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:16.552023 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:21:16.552092 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:21:16.552165 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":895,"mutex_wait_us":99,"thread_start_us":94,"threads_started":1}
I20260809 02:21:16.552487 12513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.547843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39764 (local address 127.1.81.195:39443)
0809 02:21:16.548434 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:16.548438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:16.548548 (+ 110us) server_negotiation.cc:407] Connection header received
0809 02:21:16.548633 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:16.548636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:16.548681 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:16.548755 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:16.549051 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.549699 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.551018 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.551672 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.551784 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:16.551874 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:16.552270 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 02:21:16.552363 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":86,"threads_started":1}
I20260809 02:21:16.552460 12067 tablet_service.cc:1467] Processing CreateTablet for tablet c833c311e1ce4e8e9f913190e95bc7df (DEFAULT_TABLE table=test-table [id=c6a1f2607ba144ad8c75dd180219df1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:16.552752 12067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c833c311e1ce4e8e9f913190e95bc7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:16.552812 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.547747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:43295 (local address 127.0.0.1:57434)
0809 02:21:16.548561 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.548573 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:16.548673 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:16.549034 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:16.549036 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:16.549052 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:16.549129 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:16.549134 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.549902 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.549905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:16.551011 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:16.551021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.551873 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.551877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:16.552244 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:16.552264 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:21:16.552333 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:21:16.552698 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":1,"thread_start_us":109,"threads_started":1}
I20260809 02:21:16.553030 12514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.548117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57434 (local address 127.1.81.193:43295)
0809 02:21:16.548357 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:16.548362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:16.548751 (+ 389us) server_negotiation.cc:407] Connection header received
0809 02:21:16.548806 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:16.548809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:16.548862 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:16.548932 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:16.549247 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.549804 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.551122 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.551728 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.552123 (+ 395us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:16.552186 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:16.552468 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 02:21:16.552554 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260809 02:21:16.553655 11844 tablet_service.cc:1467] Processing CreateTablet for tablet c833c311e1ce4e8e9f913190e95bc7df (DEFAULT_TABLE table=test-table [id=c6a1f2607ba144ad8c75dd180219df1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:16.553985 11844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c833c311e1ce4e8e9f913190e95bc7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:16.555001 12515 tablet_bootstrap.cc:492] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: Bootstrap starting.
I20260809 02:21:16.555143 12273 tablet_service.cc:1467] Processing CreateTablet for tablet c833c311e1ce4e8e9f913190e95bc7df (DEFAULT_TABLE table=test-table [id=c6a1f2607ba144ad8c75dd180219df1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:16.555397 12273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c833c311e1ce4e8e9f913190e95bc7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:16.556003 12515 tablet_bootstrap.cc:654] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:16.556244 12520 tablet_bootstrap.cc:492] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51: Bootstrap starting.
I20260809 02:21:16.557112 12520 tablet_bootstrap.cc:654] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:16.557323 12515 tablet_bootstrap.cc:492] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: No bootstrap required, opened a new log
I20260809 02:21:16.557407 12515 ts_tablet_manager.cc:1397] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:16.557817 12522 tablet_bootstrap.cc:492] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: Bootstrap starting.
I20260809 02:21:16.557821 12515 raft_consensus.cc:348] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.557934 12515 raft_consensus.cc:374] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:16.557976 12515 raft_consensus.cc:729] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51def44e77446bb91eda8c56b87b204, State: Initialized, Role: FOLLOWER
I20260809 02:21:16.558101 12515 consensus_queue.cc:260] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.558516 12515 ts_tablet_manager.cc:1428] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:16.559039 12522 tablet_bootstrap.cc:654] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:16.559194 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.558955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:44329)
0809 02:21:16.559076 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.559130 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 02:21:16.559973 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.559690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:60069)
0809 02:21:16.559863 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.559909 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 02:21:16.560832 12165 heartbeater.cc:503] Master 127.1.81.252:42659 was elected leader, sending a full tablet report...
I20260809 02:21:16.561035 12522 tablet_bootstrap.cc:492] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: No bootstrap required, opened a new log
I20260809 02:21:16.561115 12522 ts_tablet_manager.cc:1397] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:21:16.561235 12520 tablet_bootstrap.cc:492] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51: No bootstrap required, opened a new log
I20260809 02:21:16.561340 12520 ts_tablet_manager.cc:1397] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 02:21:16.561614 12522 raft_consensus.cc:348] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.561766 12522 raft_consensus.cc:374] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:16.561831 12522 raft_consensus.cc:729] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 715111cd7bee4c83ba4ab83b58c0cef9, State: Initialized, Role: FOLLOWER
I20260809 02:21:16.561853 12520 raft_consensus.cc:348] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.561992 12522 consensus_queue.cc:260] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.562127 12520 raft_consensus.cc:374] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:16.562203 12520 raft_consensus.cc:729] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 333629d0e916424a9eb4e6768fca6b51, State: Initialized, Role: FOLLOWER
I20260809 02:21:16.562366 12522 ts_tablet_manager.cc:1428] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:16.562355 12520 consensus_queue.cc:260] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.562712 12520 ts_tablet_manager.cc:1428] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:16.563138 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.562779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:44163)
0809 02:21:16.563023 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.563075 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260809 02:21:16.563889 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.563584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:50751)
0809 02:21:16.563711 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.563757 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 02:21:16.564395 12367 heartbeater.cc:503] Master 127.1.81.252:42659 was elected leader, sending a full tablet report...
I20260809 02:21:16.564579 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.564312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:40213)
0809 02:21:16.564453 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.564501 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 02:21:16.565169 11961 heartbeater.cc:503] Master 127.1.81.252:42659 was elected leader, sending a full tablet report...
I20260809 02:21:16.565990 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.565767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:41275)
0809 02:21:16.565877 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.565929 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 02:21:16.702453 12526 raft_consensus.cc:482] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:16.702597 12526 raft_consensus.cc:504] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.703064 12526 leader_election.cc:288] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229), 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295)
I20260809 02:21:16.703469 12092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c833c311e1ce4e8e9f913190e95bc7df" candidate_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51def44e77446bb91eda8c56b87b204" is_pre_election: true
I20260809 02:21:16.703516 11876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c833c311e1ce4e8e9f913190e95bc7df" candidate_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "333629d0e916424a9eb4e6768fca6b51" is_pre_election: true
I20260809 02:21:16.703605 12092 raft_consensus.cc:2454] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 715111cd7bee4c83ba4ab83b58c0cef9 in term 0.
I20260809 02:21:16.703689 11876 raft_consensus.cc:2454] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 715111cd7bee4c83ba4ab83b58c0cef9 in term 0.
I20260809 02:21:16.703934 12205 leader_election.cc:302] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 715111cd7bee4c83ba4ab83b58c0cef9, c51def44e77446bb91eda8c56b87b204; no voters:
I20260809 02:21:16.704134 12526 raft_consensus.cc:2781] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:16.704208 12526 raft_consensus.cc:482] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:16.704253 12526 raft_consensus.cc:3037] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:16.705245 12526 raft_consensus.cc:504] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.705562 12526 leader_election.cc:288] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [CANDIDATE]: Term 1 election: Requested vote from peers c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229), 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295)
I20260809 02:21:16.705857 12092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c833c311e1ce4e8e9f913190e95bc7df" candidate_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51def44e77446bb91eda8c56b87b204"
I20260809 02:21:16.705886 11876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c833c311e1ce4e8e9f913190e95bc7df" candidate_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "333629d0e916424a9eb4e6768fca6b51"
I20260809 02:21:16.705972 11876 raft_consensus.cc:3037] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:16.705966 12092 raft_consensus.cc:3037] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:16.706830 12092 raft_consensus.cc:2454] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 715111cd7bee4c83ba4ab83b58c0cef9 in term 1.
I20260809 02:21:16.706880 11876 raft_consensus.cc:2454] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 715111cd7bee4c83ba4ab83b58c0cef9 in term 1.
I20260809 02:21:16.707079 12205 leader_election.cc:302] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 715111cd7bee4c83ba4ab83b58c0cef9, c51def44e77446bb91eda8c56b87b204; no voters:
I20260809 02:21:16.707316 12526 raft_consensus.cc:2781] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:16.707535 12526 raft_consensus.cc:686] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 LEADER]: Becoming Leader. State: Replica: 715111cd7bee4c83ba4ab83b58c0cef9, State: Running, Role: LEADER
I20260809 02:21:16.707674 12526 consensus_queue.cc:237] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } }
I20260809 02:21:16.708274 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.708028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:44165)
0809 02:21:16.708136 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.708200 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 02:21:16.709808 11646 catalog_manager.cc:5495] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 715111cd7bee4c83ba4ab83b58c0cef9 (127.1.81.195). New cstate: current_term: 1 leader_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "715111cd7bee4c83ba4ab83b58c0cef9" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 } health_report { overall_health: UNKNOWN } } }
I20260809 02:21:16.738474 12513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.735868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39766 (local address 127.1.81.195:39443)
0809 02:21:16.735991 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:16.735995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:16.736009 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:21:16.736087 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:16.736089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:16.736133 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:16.736202 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:16.736376 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.736861 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.737644 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:16.737872 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:16.737942 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:16.738109 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:16.738181 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:16.738226 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:16.738301 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 02:21:16.738344 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:21:16.740430 11876 raft_consensus.cc:1261] T c833c311e1ce4e8e9f913190e95bc7df P 333629d0e916424a9eb4e6768fca6b51 [term 1 FOLLOWER]: Refusing update from remote peer 715111cd7bee4c83ba4ab83b58c0cef9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:16.740432 12092 raft_consensus.cc:1261] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 1 FOLLOWER]: Refusing update from remote peer 715111cd7bee4c83ba4ab83b58c0cef9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:16.740876 12526 consensus_queue.cc:1035] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51def44e77446bb91eda8c56b87b204" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:16.741036 12528 consensus_queue.cc:1035] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "333629d0e916424a9eb4e6768fca6b51" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:16.742828 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.742543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:57095)
0809 02:21:16.742696 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.742756 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 02:21:16.744102 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.742973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:52299)
0809 02:21:16.743974 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.744031 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":792}
I20260809 02:21:16.746443 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.746100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:51265)
0809 02:21:16.746321 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.746373 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260809 02:21:16.747175 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.746447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.193:48849)
0809 02:21:16.747049 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.747099 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533}
I20260809 02:21:16.747464 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.747198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.194:38657)
0809 02:21:16.747356 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.747404 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 02:21:16.749573 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.749277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:42057 (local address 127.1.81.195:54431)
0809 02:21:16.749460 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.749509 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:42057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260809 02:21:16.752346 11660 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:16.752472 11660 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:16.755693 11660 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca5f4539f8944cc7837ef80855452f3c: Sending DeleteTablet for 3 replicas of tablet c833c311e1ce4e8e9f913190e95bc7df
I20260809 02:21:16.756299 12067 tablet_service.cc:1514] Processing DeleteTablet for tablet c833c311e1ce4e8e9f913190e95bc7df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:16 UTC) from {username='oryx', principal='oryx/127.1.81.252@KRBTEST.COM'} at 127.0.0.1:58196
I20260809 02:21:16.756354 12273 tablet_service.cc:1514] Processing DeleteTablet for tablet c833c311e1ce4e8e9f913190e95bc7df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:16 UTC) from {username='oryx', principal='oryx/127.1.81.252@KRBTEST.COM'} at 127.0.0.1:39764
I20260809 02:21:16.756605 11844 tablet_service.cc:1514] Processing DeleteTablet for tablet c833c311e1ce4e8e9f913190e95bc7df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:16 UTC) from {username='oryx', principal='oryx/127.1.81.252@KRBTEST.COM'} at 127.0.0.1:57434
I20260809 02:21:16.756681 12548 tablet_replica.cc:330] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: stopping tablet replica
I20260809 02:21:16.756809 12548 raft_consensus.cc:2229] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:16.756933 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 11598
I20260809 02:21:16.759544 12548 raft_consensus.cc:2258] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:16.764180 12548 ts_tablet_manager.cc:1905] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:16.766496 12548 ts_tablet_manager.cc:1918] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:16.766583 12548 log.cc:1196] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/c833c311e1ce4e8e9f913190e95bc7df
I20260809 02:21:16.766935 12548 ts_tablet_manager.cc:1939] T c833c311e1ce4e8e9f913190e95bc7df P c51def44e77446bb91eda8c56b87b204: Deleting consensus metadata
I20260809 02:21:16.768803 11636 catalog_manager.cc:4841] TS c51def44e77446bb91eda8c56b87b204 (127.1.81.194:34229): tablet c833c311e1ce4e8e9f913190e95bc7df (table test-table [id=c6a1f2607ba144ad8c75dd180219df1b]) successfully deleted
I20260809 02:21:16.771951 12549 tablet_replica.cc:330] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: stopping tablet replica
I20260809 02:21:16.772070 12549 raft_consensus.cc:2229] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:16.772269 12549 raft_consensus.cc:2258] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:16.772809 12549 ts_tablet_manager.cc:1905] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:16.774808 12549 ts_tablet_manager.cc:1918] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:16.774869 12549 log.cc:1196] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/c833c311e1ce4e8e9f913190e95bc7df
I20260809 02:21:16.775092 12549 ts_tablet_manager.cc:1939] T c833c311e1ce4e8e9f913190e95bc7df P 715111cd7bee4c83ba4ab83b58c0cef9: Deleting consensus metadata
I20260809 02:21:16.775657 11632 catalog_manager.cc:4841] TS 715111cd7bee4c83ba4ab83b58c0cef9 (127.1.81.195:39443): tablet c833c311e1ce4e8e9f913190e95bc7df (table test-table [id=c6a1f2607ba144ad8c75dd180219df1b]) successfully deleted
I20260809 02:21:16.776464 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 11972
I20260809 02:21:16.777944 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:16.776515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:43295 (local address 127.0.0.1:57440)
0809 02:21:16.777807 (+ 1292us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:16.777864 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:43295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1205}
W20260809 02:21:16.779076 11633 catalog_manager.cc:4584] TS 333629d0e916424a9eb4e6768fca6b51 (127.1.81.193:43295): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c833c311e1ce4e8e9f913190e95bc7df: Network error: Client connection negotiation failed: client connection to 127.1.81.193:43295: connect: Connection refused (error 111)
I20260809 02:21:16.790208 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 12174
I20260809 02:21:16.802392 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 11158
I20260809 02:21:16.812641 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 11329
2026-08-09T02:21:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7233 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:16 dist-test-slave-jlzn krb5kdc[12555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:16 dist-test-slave-jlzn krb5kdc[12555](info): set up 2 sockets
Aug 09 02:21:16 dist-test-slave-jlzn krb5kdc[12555](info): commencing operation
krb5kdc: starting...
W20260809 02:21:17.940544 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:18Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.254.keytab.
Entry for principal oryx/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.254.keytab.
I20260809 02:21:18.067449 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:36555
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.254.keytab
--principal=oryx/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:33131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:36555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:18.172307 12575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:18.172521 12575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:18.172561 12575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:18.176381 12575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:18.176425 12575 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:21:18.176442 12575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:18.176472 12575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:18.176501 12575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:18.176525 12575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:18.181454 12575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:33131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:36555
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.254.keytab
--principal=oryx/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:36555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:18.182312 12575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:18.183211 12575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:18.190968 12582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:18.191005 12583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:18.191022 12585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:18.191354 12575 server_base.cc:1034] running on GCE node
I20260809 02:21:18.192003 12575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:18.192976 12575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:18.194126 12575 hybrid_clock.cc:648] HybridClock initialized: now 1786242078194110 us; error 25 us; skew 500 ppm
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:18.196643 12575 init.cc:377] Logged in from keytab as oryx/127.1.81.254@KRBTEST.COM (short username oryx)
I20260809 02:21:18.197432 12575 webserver.cc:460] Webserver started at http://127.1.81.254:35519/ using document root <none> and password file <none>
I20260809 02:21:18.197921 12575 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:18.197984 12575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:18.198163 12575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:18.200066 12575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "36c334dd29bf422ca30343b919237465"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "75939ce4306f90a72d1e13960ad47529"
server_key_iv: "576fcf089aad872b6c666abe2f94b473"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.200575 12575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "36c334dd29bf422ca30343b919237465"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "75939ce4306f90a72d1e13960ad47529"
server_key_iv: "576fcf089aad872b6c666abe2f94b473"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.203837 12575 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:18.205931 12597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:18.207016 12575 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:18.207126 12575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "36c334dd29bf422ca30343b919237465"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "75939ce4306f90a72d1e13960ad47529"
server_key_iv: "576fcf089aad872b6c666abe2f94b473"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.207211 12575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:18.217912 12575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:18.220239 12575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:18.220394 12575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:18.227421 12575 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:36555
I20260809 02:21:18.227434 12693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:36555 every 8 connection(s)
I20260809 02:21:18.228258 12575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:18.230717 12694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:18.232138 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 12575
I20260809 02:21:18.232254 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:18.232506 1351 external_mini_cluster.cc:1428] Setting key 5fb9b6ce1a45ba8d073439bc20fe5f03
I20260809 02:21:18.236513 12694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: Bootstrap starting.
I20260809 02:21:18.238857 12694 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:18.239722 12694 log.cc:824] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:18.241585 12694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: No bootstrap required, opened a new log
I20260809 02:21:18.245236 12694 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36c334dd29bf422ca30343b919237465" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36555 } }
I20260809 02:21:18.245532 12694 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:18.245599 12694 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c334dd29bf422ca30343b919237465, State: Initialized, Role: FOLLOWER
I20260809 02:21:18.246032 12694 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36c334dd29bf422ca30343b919237465" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36555 } }
I20260809 02:21:18.246188 12694 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:18.246253 12694 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:18.246341 12694 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:18.246523 12698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.233735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35810 (local address 127.1.81.254:36555)
0809 02:21:18.234097 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.234112 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.234145 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:21:18.234759 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.234774 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.235055 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.235301 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.236212 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.237165 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.238313 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.238742 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.238845 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.241369 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:18.241375 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:18.241389 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:18.241417 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:18.243776 (+ 2359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.244181 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.244186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.244192 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.244328 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.244541 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.244544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.244545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.245007 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:18.245205 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.245375 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.245659 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":95,"threads_started":1}
I20260809 02:21:18.247195 12694 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36c334dd29bf422ca30343b919237465" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36555 } }
I20260809 02:21:18.247486 12694 leader_election.cc:302] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36c334dd29bf422ca30343b919237465; no voters:
I20260809 02:21:18.247741 12694 leader_election.cc:288] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:18.247864 12701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:18.248088 12701 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [term 1 LEADER]: Becoming Leader. State: Replica: 36c334dd29bf422ca30343b919237465, State: Running, Role: LEADER
I20260809 02:21:18.248415 12701 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36c334dd29bf422ca30343b919237465" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36555 } }
I20260809 02:21:18.248884 12694 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:18.249435 12701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36c334dd29bf422ca30343b919237465. Latest consensus state: current_term: 1 leader_uuid: "36c334dd29bf422ca30343b919237465" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36c334dd29bf422ca30343b919237465" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36555 } } }
I20260809 02:21:18.249627 12701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:18.249888 12702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36c334dd29bf422ca30343b919237465" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36c334dd29bf422ca30343b919237465" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36555 } } }
I20260809 02:21:18.250051 12702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:18.250069 12713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:18.252939 12713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:18.258147 12713 catalog_manager.cc:1347] Generated new cluster ID: c17a0551145b455ca51b9e28a2301951
I20260809 02:21:18.258200 12713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:18.266319 12713 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:18.267402 12713 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:18.279430 12713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: Generated new TSK 0
I20260809 02:21:18.279994 12713 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab.
Entry for principal oryx/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab.
I20260809 02:21:18.312408 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36555
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab
--principal=oryx/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:33131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:18.419838 12726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:18.420056 12726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:18.420097 12726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:18.423914 12726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:18.423960 12726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:18.423997 12726 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:21:18.424044 12726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:18.428939 12726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:33131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab
--principal=oryx/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:36555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:18.429803 12726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:18.430701 12726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:18.439426 12733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:18.439426 12739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:18.439419 12734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:18.439599 12726 server_base.cc:1034] running on GCE node
I20260809 02:21:18.440085 12726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:18.440651 12726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:18.441803 12726 hybrid_clock.cc:648] HybridClock initialized: now 1786242078441788 us; error 27 us; skew 500 ppm
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:18.444362 12726 init.cc:377] Logged in from keytab as oryx/127.1.81.193@KRBTEST.COM (short username oryx)
I20260809 02:21:18.445101 12726 webserver.cc:460] Webserver started at http://127.1.81.193:36379/ using document root <none> and password file <none>
I20260809 02:21:18.445585 12726 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:18.445649 12726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:18.445819 12726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:18.447611 12726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "9efcbc049ae6ed44ad8715e720f73deb"
server_key_iv: "1364f554995c943724b005c94163e448"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.448171 12726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "9efcbc049ae6ed44ad8715e720f73deb"
server_key_iv: "1364f554995c943724b005c94163e448"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.451658 12726 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:18.453799 12749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:18.454852 12726 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:18.454957 12726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "9efcbc049ae6ed44ad8715e720f73deb"
server_key_iv: "1364f554995c943724b005c94163e448"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.455040 12726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:18.488672 12726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:18.491209 12726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:18.491365 12726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:18.492730 12726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:18.492779 12726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:18.492828 12726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:18.492854 12726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:18.502768 12726 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:44731
I20260809 02:21:18.502844 12937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:44731 every 8 connection(s)
I20260809 02:21:18.503567 12726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:18.505128 12698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.493449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:56765 (local address 127.1.81.254:36555)
0809 02:21:18.493594 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.493600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.494359 (+ 759us) server_negotiation.cc:407] Connection header received
0809 02:21:18.495385 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.495389 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.495451 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.495546 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.496949 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.497480 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.498664 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.498960 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.499057 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.501719 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:18.501723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:18.501726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:18.501752 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:18.503174 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.503633 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.503637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.503639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.503736 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.504109 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.504120 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.504122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.504344 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:18.504427 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.504896 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.505003 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:21:18.505791 12762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.493774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36555 (local address 127.1.81.193:56765)
0809 02:21:18.494210 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.494259 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.495155 (+ 896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.495839 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.495848 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.496239 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:18.496804 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.496821 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.497618 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.497622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.498541 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.498551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.499122 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.499126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.499308 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.499868 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:18.499890 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:18.501556 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:18.503279 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.503285 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.503298 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.503539 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.503841 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.503844 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.503846 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.504002 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.504431 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:18.504436 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:18.504694 (+ 258us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.504835 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.505056 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":104,"threads_started":1}
I20260809 02:21:18.506822 12938 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36555
I20260809 02:21:18.506953 12938 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:18.507395 12938 heartbeater.cc:511] Master 127.1.81.254:36555 requested a full tablet report, sending...
I20260809 02:21:18.507931 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 12726
I20260809 02:21:18.508056 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:18.508385 1351 external_mini_cluster.cc:1428] Setting key b4d6962eb0ccc76e87ad3fcd0add17c1
I20260809 02:21:18.509027 12621 ts_manager.cc:194] Registered new tserver with Master: c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731)
I20260809 02:21:18.510468 12621 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:56765
I20260809 02:21:18.515632 12698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.508868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:55027 (local address 127.1.81.254:36555)
0809 02:21:18.508973 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.508977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.509234 (+ 257us) server_negotiation.cc:407] Connection header received
0809 02:21:18.509392 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.509395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.509432 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.509474 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.510048 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.510684 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.511591 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.511916 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.512004 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.512965 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:18.512968 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:18.512971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:18.512995 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:18.514193 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.514569 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.514573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.514575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.514656 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.514970 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.514972 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.514974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.515125 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:18.515199 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.515447 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.515530 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:21:18.515646 12949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.508894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36555 (local address 127.1.81.193:55027)
0809 02:21:18.509160 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.509173 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.509297 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.509601 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.509604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.509790 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:18.509898 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.509905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.510835 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.510838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.511455 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.511465 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.512021 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.512025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.512118 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.512533 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:18.512547 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:18.512838 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:18.514294 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.514298 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.514300 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.514484 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.514770 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.514774 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.514776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.514881 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.515211 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:18.515214 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:18.515306 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.515409 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.515507 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":92,"threads_started":1}
WARNING: no policy specified for oryx/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab.
Entry for principal oryx/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab.
I20260809 02:21:18.534363 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36555
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab
--principal=oryx/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:33131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:18.640710 12954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:18.640920 12954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:18.640982 12954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:18.644838 12954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:18.644886 12954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:18.644932 12954 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:21:18.644985 12954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:18.649955 12954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:33131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab
--principal=oryx/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:36555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:18.650822 12954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:18.651734 12954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:18.660602 12964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:18.660696 12954 server_base.cc:1034] running on GCE node
W20260809 02:21:18.660703 12966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:18.660907 12972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:18.661285 12954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:18.661832 12954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:18.662976 12954 hybrid_clock.cc:648] HybridClock initialized: now 1786242078662954 us; error 34 us; skew 500 ppm
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:18.665561 12954 init.cc:377] Logged in from keytab as oryx/127.1.81.194@KRBTEST.COM (short username oryx)
I20260809 02:21:18.666306 12954 webserver.cc:460] Webserver started at http://127.1.81.194:41341/ using document root <none> and password file <none>
I20260809 02:21:18.666762 12954 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:18.666816 12954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:18.666967 12954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:18.668849 12954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "176183f09b3f483ab086609efc4b091d"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "43fb5113615a524bf81d199fd4ed78b9"
server_key_iv: "e2c023459942606ebed9da8b47625499"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.669335 12954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "176183f09b3f483ab086609efc4b091d"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "43fb5113615a524bf81d199fd4ed78b9"
server_key_iv: "e2c023459942606ebed9da8b47625499"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.672675 12954 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:18.674772 12988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:18.675859 12954 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:18.675953 12954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "176183f09b3f483ab086609efc4b091d"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "43fb5113615a524bf81d199fd4ed78b9"
server_key_iv: "e2c023459942606ebed9da8b47625499"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.676031 12954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:18.696220 12954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:18.698928 12954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:18.699061 12954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:18.700340 12954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:18.700389 12954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:18.700426 12954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:18.700456 12954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:18.710449 12954 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:37409
I20260809 02:21:18.710639 13161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:37409 every 8 connection(s)
I20260809 02:21:18.711450 12954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:18.713505 12698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.701007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:52235 (local address 127.1.81.254:36555)
0809 02:21:18.701121 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.701124 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.702151 (+ 1027us) server_negotiation.cc:407] Connection header received
0809 02:21:18.703028 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.703031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.703091 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.703181 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.704603 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.705409 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.706590 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.706958 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.707082 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.709744 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:18.709749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:18.709751 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:18.709805 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:18.711352 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.711987 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.711992 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.711994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.712097 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.712473 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.712477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.712478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.712660 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:18.712745 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.713224 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.713348 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:21:18.714133 13000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.701540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36555 (local address 127.1.81.194:52235)
0809 02:21:18.702002 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.702041 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.702826 (+ 785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.703452 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.703460 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.703915 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:18.704435 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.704455 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.705542 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.705545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.706452 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.706463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.707132 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.707137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.707326 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.707904 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:18.707926 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:18.709575 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:18.711454 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.711460 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.711472 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.711823 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.712197 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.712201 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.712203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.712371 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.712767 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:18.712773 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:18.712985 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.713132 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.713418 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":136,"threads_started":1}
I20260809 02:21:18.715159 13162 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36555
I20260809 02:21:18.715297 13162 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:18.715837 13162 heartbeater.cc:511] Master 127.1.81.254:36555 requested a full tablet report, sending...
I20260809 02:21:18.716912 12623 ts_manager.cc:194] Registered new tserver with Master: 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409)
I20260809 02:21:18.717650 12623 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:52235
I20260809 02:21:18.719462 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 12954
I20260809 02:21:18.719583 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:18.719866 1351 external_mini_cluster.cc:1428] Setting key 69d17b394b707861d23733b5fec75293
I20260809 02:21:18.723708 13170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.717195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36555 (local address 127.1.81.194:46411)
0809 02:21:18.717499 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.717512 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.717602 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.717892 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.717894 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.718046 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:18.718132 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.718137 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.718840 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.718844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.719599 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.719609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.720121 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.720125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.720218 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.720574 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:18.720585 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:18.720875 (+ 290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:18.722301 (+ 1426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.722304 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.722305 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.722522 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.722779 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.722782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.722784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.722864 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.723234 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:18.723238 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:18.723325 (+ 87us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.723409 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.723539 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":98,"threads_started":1}
I20260809 02:21:18.723708 12698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.717246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:46411 (local address 127.1.81.254:36555)
0809 02:21:18.717341 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.717344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.717570 (+ 226us) server_negotiation.cc:407] Connection header received
0809 02:21:18.717686 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.717688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.717722 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.717796 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.718243 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.718717 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.719715 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.720011 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.720094 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.721016 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:18.721019 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:18.721022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:18.721045 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:18.722179 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.722610 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.722613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.722615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.722699 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.722942 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.722945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.722947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.723140 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:18.723229 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.723473 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.723570 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
WARNING: no policy specified for oryx/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab.
Entry for principal oryx/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab.
I20260809 02:21:18.743873 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36555
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab
--principal=oryx/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:33131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:18.852102 13176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:18.852339 13176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:18.852397 13176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:18.856238 13176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:18.856288 13176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:18.856339 13176 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:21:18.856387 13176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:18.861491 13176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:33131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab
--principal=oryx/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.81.254:36555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:18.862371 13176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:18.863297 13176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:18.874428 13184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:18.874442 13189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:18.874472 13186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:18.874655 13176 server_base.cc:1034] running on GCE node
I20260809 02:21:18.875118 13176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:18.875669 13176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:18.876812 13176 hybrid_clock.cc:648] HybridClock initialized: now 1786242078876786 us; error 44 us; skew 500 ppm
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:18.879454 13176 init.cc:377] Logged in from keytab as oryx/127.1.81.195@KRBTEST.COM (short username oryx)
I20260809 02:21:18.880245 13176 webserver.cc:460] Webserver started at http://127.1.81.195:34615/ using document root <none> and password file <none>
I20260809 02:21:18.880734 13176 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:18.880791 13176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:18.880976 13176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:18.882830 13176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "3a6b2171f02b425896f65b8053c8e1a7"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "f8bdd1863e6fbb5ca92cb1b08fb61ee5"
server_key_iv: "8554acd8eeea4a68247b872ecfa374fc"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.883342 13176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "3a6b2171f02b425896f65b8053c8e1a7"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "f8bdd1863e6fbb5ca92cb1b08fb61ee5"
server_key_iv: "8554acd8eeea4a68247b872ecfa374fc"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.886663 13176 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:21:18.888833 13198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:18.889925 13176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:18.890021 13176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "3a6b2171f02b425896f65b8053c8e1a7"
format_stamp: "Formatted at 2026-08-09 02:21:18 on dist-test-slave-jlzn"
server_key: "f8bdd1863e6fbb5ca92cb1b08fb61ee5"
server_key_iv: "8554acd8eeea4a68247b872ecfa374fc"
server_key_version: "encryptionkey@0"
I20260809 02:21:18.890115 13176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:18.919462 13176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:18.922346 13176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:18.922508 13176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:18.923872 13176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:18.923923 13176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:18.923975 13176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:18.924003 13176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:18.934242 13176 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:34163
I20260809 02:21:18.934331 13372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:34163 every 8 connection(s)
I20260809 02:21:18.935236 13176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:18.937520 12698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.924616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:54461 (local address 127.1.81.254:36555)
0809 02:21:18.924733 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.924736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.925713 (+ 977us) server_negotiation.cc:407] Connection header received
0809 02:21:18.926626 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.926630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.926691 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.926783 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.928429 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.929004 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.930658 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.930878 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.930977 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.934355 (+ 3378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:18.934359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:18.934362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:18.934388 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:18.935821 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.936369 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.936372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.936374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.936459 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.936709 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.936711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.936712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.936868 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:18.936938 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.937305 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.937399 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:21:18.938197 13213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.925095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36555 (local address 127.1.81.195:54461)
0809 02:21:18.925568 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.925609 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.926419 (+ 810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.927086 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.927096 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.927556 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:18.928242 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.928263 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.929121 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.929125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.930541 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.930553 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.931062 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.931067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.931275 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.932466 (+ 1191us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:18.932487 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:18.934192 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:18.935950 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.935955 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.935968 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.936280 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.936528 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.936530 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.936531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.936648 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.936928 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:18.936932 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:18.937134 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.937270 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.937482 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":129,"threads_started":1}
I20260809 02:21:18.939330 13374 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36555
I20260809 02:21:18.939471 13374 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:18.939661 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 13176
I20260809 02:21:18.939787 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:18.939997 13374 heartbeater.cc:511] Master 127.1.81.254:36555 requested a full tablet report, sending...
I20260809 02:21:18.940143 1351 external_mini_cluster.cc:1428] Setting key d297fbac1445917683069b9aa59c34cf
I20260809 02:21:18.941042 12621 ts_manager.cc:194] Registered new tserver with Master: 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163)
I20260809 02:21:18.941780 12621 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:54461
I20260809 02:21:18.942152 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:21:18.947860 12698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.941492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:53205 (local address 127.1.81.254:36555)
0809 02:21:18.941590 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.941592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.941844 (+ 252us) server_negotiation.cc:407] Connection header received
0809 02:21:18.941972 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.941975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.942017 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.942077 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.942508 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.942983 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.943771 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.944025 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.944111 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.945186 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:18.945190 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:18.945193 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:18.945217 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:18.946356 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.946784 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.946786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.946787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.946851 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.947130 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.947131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.947132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.947267 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:18.947355 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.947602 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.947708 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:21:18.947863 13382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.941428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36555 (local address 127.1.81.195:53205)
0809 02:21:18.941767 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.941777 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.941864 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.942103 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.942106 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.942310 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:18.942404 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.942410 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.943104 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.943107 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.943665 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.943673 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.944125 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.944128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.944224 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.944678 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:18.944692 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:18.945045 (+ 353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:18.946460 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.946463 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.946465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.946702 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.946921 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:18.946925 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:18.946927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:18.947043 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:18.947367 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:18.947370 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:18.947452 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.947537 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.947659 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":174,"threads_started":1}
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:21:18.965996 12698 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:18.960931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35820 (local address 127.1.81.254:36555)
0809 02:21:18.961033 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.961035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.961046 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:21:18.961074 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.961076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.961107 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.961175 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.961765 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.962230 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.963019 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.963218 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.963279 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.965894 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35820: BlockingRecv error: recv got EOF from 127.0.0.1:35820 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:21:18 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:18.974174 12698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.967172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35830 (local address 127.1.81.254:36555)
0809 02:21:18.967289 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.967293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.967404 (+ 111us) server_negotiation.cc:407] Connection header received
0809 02:21:18.967517 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.967520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.967557 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.967613 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:18.968267 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.968739 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.969534 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.969747 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.969833 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.971870 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:18.971873 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:18.971875 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:18.971896 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:18.973018 (+ 1122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.973371 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.973373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.973374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.973440 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:18.973612 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:18.973614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:18.973615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:18.973760 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:18.973849 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.973994 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.974073 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:21:18.976523 12621 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:18.979337 12621 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:18.992977 13407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.987022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:37409 (local address 127.0.0.1:56776)
0809 02:21:18.987608 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.987660 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.988222 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.988926 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.988929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.988945 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:18.989124 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.989131 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.990454 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.990457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.991386 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.991396 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.992535 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.992538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.992633 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.992657 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.992700 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.992832 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":39,"thread_start_us":79,"threads_started":1}
I20260809 02:21:18.992990 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.987012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42474 (local address 127.1.81.195:34163)
0809 02:21:18.987918 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.987929 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.987950 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:21:18.988023 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.988028 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.988229 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.988622 (+ 393us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:18.989037 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.990160 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.991738 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.992348 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.992477 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.992646 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.992757 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.992853 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803,"thread_start_us":112,"threads_started":1}
I20260809 02:21:18.992980 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.986872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:34163 (local address 127.0.0.1:42474)
0809 02:21:18.987608 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.987661 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.987775 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.988611 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.988617 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.988641 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:18.988765 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.988772 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.990269 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.990272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.991623 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.991634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.992456 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.992460 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.992572 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.992606 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.992727 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.992840 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":28,"thread_start_us":76,"threads_started":1}
I20260809 02:21:18.993844 13410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.987199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56776 (local address 127.1.81.194:37409)
0809 02:21:18.988530 (+ 1331us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.988541 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.988563 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:21:18.988636 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.988640 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.988807 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.988943 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:18.989244 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.990329 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.991512 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.992401 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.993412 (+ 1011us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.993569 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.993617 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.993701 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1227,"thread_start_us":99,"threads_started":1}
I20260809 02:21:18.994506 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.988188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58436 (local address 127.1.81.193:44731)
0809 02:21:18.988457 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:18.988473 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:18.988493 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:21:18.988556 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:18.988561 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:18.988740 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:18.988892 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:18.990365 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.991514 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.992852 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.993720 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.993815 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.993966 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:18.994267 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 02:21:18.994366 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":75,"threads_started":1}
I20260809 02:21:18.994519 13411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:18.987695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:44731 (local address 127.0.0.1:58436)
0809 02:21:18.988193 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:18.988206 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:18.988287 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:18.988896 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:18.988900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:18.988918 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:18.989124 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.989131 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.991646 (+ 2515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.991650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.992729 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:18.992736 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:18.994030 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:18.994033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:18.994118 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:18.994141 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:21:18.994218 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:21:18.994346 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"mutex_wait_us":75,"spinlock_wait_cycles":768,"thread_start_us":123,"threads_started":1}
I20260809 02:21:18.995918 13278 tablet_service.cc:1467] Processing CreateTablet for tablet cc920251117947598a41d9432961bebd (DEFAULT_TABLE table=test-table [id=0d29b04adeaa492c8c58c39e0d30a628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:18.996157 13065 tablet_service.cc:1467] Processing CreateTablet for tablet cc920251117947598a41d9432961bebd (DEFAULT_TABLE table=test-table [id=0d29b04adeaa492c8c58c39e0d30a628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:18.996978 13278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc920251117947598a41d9432961bebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:18.997026 13065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc920251117947598a41d9432961bebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:18.998342 12837 tablet_service.cc:1467] Processing CreateTablet for tablet cc920251117947598a41d9432961bebd (DEFAULT_TABLE table=test-table [id=0d29b04adeaa492c8c58c39e0d30a628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:18.999270 12837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc920251117947598a41d9432961bebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.003579 13414 tablet_bootstrap.cc:492] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Bootstrap starting.
I20260809 02:21:19.004870 13415 tablet_bootstrap.cc:492] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Bootstrap starting.
I20260809 02:21:19.005972 13414 tablet_bootstrap.cc:654] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.006173 13416 tablet_bootstrap.cc:492] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Bootstrap starting.
I20260809 02:21:19.006954 13415 tablet_bootstrap.cc:654] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.007180 13414 log.cc:824] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:19.007767 13415 log.cc:824] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:19.008216 13416 tablet_bootstrap.cc:654] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.008941 13416 log.cc:824] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:19.009696 13414 tablet_bootstrap.cc:492] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: No bootstrap required, opened a new log
I20260809 02:21:19.009696 13415 tablet_bootstrap.cc:492] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: No bootstrap required, opened a new log
I20260809 02:21:19.009881 13415 ts_tablet_manager.cc:1397] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:21:19.009881 13414 ts_tablet_manager.cc:1397] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:21:19.010521 13416 tablet_bootstrap.cc:492] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: No bootstrap required, opened a new log
I20260809 02:21:19.010704 13416 ts_tablet_manager.cc:1397] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:21:19.013556 13416 raft_consensus.cc:348] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.013767 13416 raft_consensus.cc:374] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.013827 13416 raft_consensus.cc:729] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6fdec68fd8b4bd2ab0af592ef7d88a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.013671 13414 raft_consensus.cc:348] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.013671 13415 raft_consensus.cc:348] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.013898 13415 raft_consensus.cc:374] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.013898 13414 raft_consensus.cc:374] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.013958 13415 raft_consensus.cc:729] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6b2171f02b425896f65b8053c8e1a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.013958 13414 raft_consensus.cc:729] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176183f09b3f483ab086609efc4b091d, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.014325 13416 consensus_queue.cc:260] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.014353 13414 consensus_queue.cc:260] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.014492 13415 consensus_queue.cc:260] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.015292 13416 ts_tablet_manager.cc:1428] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260809 02:21:19.015303 13415 ts_tablet_manager.cc:1428] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:21:19.015303 13414 ts_tablet_manager.cc:1428] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260809 02:21:19.015651 12938 heartbeater.cc:503] Master 127.1.81.254:36555 was elected leader, sending a full tablet report...
I20260809 02:21:19.015862 13374 heartbeater.cc:503] Master 127.1.81.254:36555 was elected leader, sending a full tablet report...
I20260809 02:21:19.015883 13162 heartbeater.cc:503] Master 127.1.81.254:36555 was elected leader, sending a full tablet report...
W20260809 02:21:19.186235 13376 tablet.cc:2369] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:21:19.212630 13163 tablet.cc:2369] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:19.229737 13423 raft_consensus.cc:482] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:19.229941 13423 raft_consensus.cc:504] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.231206 13423 leader_election.cc:288] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163), 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409)
I20260809 02:21:19.235569 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.231369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:37409 (local address 127.1.81.193:37559)
0809 02:21:19.231880 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.231896 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.232003 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.232329 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.232332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.232350 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:19.232463 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.232470 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.233484 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.233487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.234508 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.234516 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.235134 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.235138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.235243 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.235268 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.235342 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.235412 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":13,"thread_start_us":57,"threads_started":1}
I20260809 02:21:19.235584 13410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.231724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:37559 (local address 127.1.81.194:37409)
0809 02:21:19.231854 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.231858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.231964 (+ 106us) server_negotiation.cc:407] Connection header received
0809 02:21:19.232160 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.232164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.232217 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.232280 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:19.232584 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.233372 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.234618 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.235014 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.235122 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.235178 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.235380 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.235464 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:19.235677 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.231548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:53507 (local address 127.1.81.195:34163)
0809 02:21:19.231681 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.231686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.231877 (+ 191us) server_negotiation.cc:407] Connection header received
0809 02:21:19.232073 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.232076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.232127 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.232198 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:19.232472 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.233022 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.234393 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.235024 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.235137 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.235199 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.235472 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.235553 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:21:19.236032 13425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.231369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:34163 (local address 127.1.81.193:53507)
0809 02:21:19.231772 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.231787 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.231961 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.232219 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.232222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.232236 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:19.232359 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.232364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.233128 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.233131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.234254 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.234265 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.235248 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.235251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.235339 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.235358 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.235829 (+ 471us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.235904 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":70,"threads_started":1}
I20260809 02:21:19.236552 13097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc920251117947598a41d9432961bebd" candidate_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176183f09b3f483ab086609efc4b091d" is_pre_election: true
I20260809 02:21:19.236706 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc920251117947598a41d9432961bebd" candidate_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6b2171f02b425896f65b8053c8e1a7" is_pre_election: true
I20260809 02:21:19.236841 13097 raft_consensus.cc:2454] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6fdec68fd8b4bd2ab0af592ef7d88a7 in term 0.
I20260809 02:21:19.236971 13306 raft_consensus.cc:2454] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6fdec68fd8b4bd2ab0af592ef7d88a7 in term 0.
I20260809 02:21:19.237411 12754 leader_election.cc:302] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a6b2171f02b425896f65b8053c8e1a7, c6fdec68fd8b4bd2ab0af592ef7d88a7; no voters:
I20260809 02:21:19.237668 13423 raft_consensus.cc:2781] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:19.237756 13423 raft_consensus.cc:482] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:19.237807 13423 raft_consensus.cc:3037] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.238933 13423 raft_consensus.cc:504] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.239252 13423 leader_election.cc:288] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [CANDIDATE]: Term 1 election: Requested vote from peers 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163), 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409)
I20260809 02:21:19.239547 13097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc920251117947598a41d9432961bebd" candidate_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176183f09b3f483ab086609efc4b091d"
I20260809 02:21:19.239573 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc920251117947598a41d9432961bebd" candidate_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6b2171f02b425896f65b8053c8e1a7"
I20260809 02:21:19.239676 13097 raft_consensus.cc:3037] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.239705 13306 raft_consensus.cc:3037] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.240677 13097 raft_consensus.cc:2454] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6fdec68fd8b4bd2ab0af592ef7d88a7 in term 1.
I20260809 02:21:19.240998 12750 leader_election.cc:302] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176183f09b3f483ab086609efc4b091d, c6fdec68fd8b4bd2ab0af592ef7d88a7; no voters:
I20260809 02:21:19.241178 13423 raft_consensus.cc:2781] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:19.241379 13423 raft_consensus.cc:686] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 LEADER]: Becoming Leader. State: Replica: c6fdec68fd8b4bd2ab0af592ef7d88a7, State: Running, Role: LEADER
I20260809 02:21:19.241401 13306 raft_consensus.cc:2454] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6fdec68fd8b4bd2ab0af592ef7d88a7 in term 1.
I20260809 02:21:19.241710 13423 consensus_queue.cc:237] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } }
I20260809 02:21:19.244518 12620 catalog_manager.cc:5495] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193). New cstate: current_term: 1 leader_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } health_report { overall_health: HEALTHY } } }
W20260809 02:21:19.254880 12939 tablet.cc:2369] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:19.277683 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.274771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58440 (local address 127.1.81.193:44731)
0809 02:21:19.274872 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.274875 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.274887 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:19.275014 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.275016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.275063 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.275144 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:19.275317 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.275781 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.276572 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.276778 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.276847 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.277035 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:19.277396 (+ 361us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:19.277476 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.277517 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.277559 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:21:19.282811 13097 raft_consensus.cc:1261] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Refusing update from remote peer c6fdec68fd8b4bd2ab0af592ef7d88a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:19.282816 13306 raft_consensus.cc:1261] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Refusing update from remote peer c6fdec68fd8b4bd2ab0af592ef7d88a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:19.283447 13428 consensus_queue.cc:1035] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:19.283607 13423 consensus_queue.cc:1035] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:19.298105 12623 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:19.298280 12623 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:19.300603 12623 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: Sending DeleteTablet for 3 replicas of tablet cc920251117947598a41d9432961bebd
I20260809 02:21:19.301333 13065 tablet_service.cc:1514] Processing DeleteTablet for tablet cc920251117947598a41d9432961bebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:19 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:56776
I20260809 02:21:19.301333 13278 tablet_service.cc:1514] Processing DeleteTablet for tablet cc920251117947598a41d9432961bebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:19 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42474
I20260809 02:21:19.301661 12837 tablet_service.cc:1514] Processing DeleteTablet for tablet cc920251117947598a41d9432961bebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:19 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58436
I20260809 02:21:19.302053 13453 tablet_replica.cc:330] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: stopping tablet replica
I20260809 02:21:19.302171 13450 tablet_replica.cc:330] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: stopping tablet replica
I20260809 02:21:19.302263 12623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 02:21:19.302356 13453 raft_consensus.cc:2229] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:19.302438 13450 raft_consensus.cc:2229] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260809 02:21:19.302639 12623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:19.302652 13453 raft_consensus.cc:2258] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:19.302704 13450 raft_consensus.cc:2258] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:19.304109 13450 ts_tablet_manager.cc:1905] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:19.306187 13453 ts_tablet_manager.cc:1905] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:19.307147 12837 tablet_service.cc:1467] Processing CreateTablet for tablet 2395a753239f4508a0029b9bdde42212 (DEFAULT_TABLE table=test-table [id=eed628eaacb54d41800f47ee6f2bfe16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:19.307226 13065 tablet_service.cc:1467] Processing CreateTablet for tablet 2395a753239f4508a0029b9bdde42212 (DEFAULT_TABLE table=test-table [id=eed628eaacb54d41800f47ee6f2bfe16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:19.307353 13278 tablet_service.cc:1467] Processing CreateTablet for tablet 2395a753239f4508a0029b9bdde42212 (DEFAULT_TABLE table=test-table [id=eed628eaacb54d41800f47ee6f2bfe16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:19.307457 13065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2395a753239f4508a0029b9bdde42212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.307603 13278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2395a753239f4508a0029b9bdde42212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.308496 12837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2395a753239f4508a0029b9bdde42212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.309599 13414 tablet_bootstrap.cc:492] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: Bootstrap starting.
I20260809 02:21:19.310525 13414 tablet_bootstrap.cc:654] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.310847 13416 tablet_bootstrap.cc:492] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Bootstrap starting.
I20260809 02:21:19.311106 13415 tablet_bootstrap.cc:492] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: Bootstrap starting.
I20260809 02:21:19.311776 13416 tablet_bootstrap.cc:654] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.312096 13415 tablet_bootstrap.cc:654] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.312532 13414 tablet_bootstrap.cc:492] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: No bootstrap required, opened a new log
I20260809 02:21:19.312619 13414 ts_tablet_manager.cc:1397] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 02:21:19.313220 13415 tablet_bootstrap.cc:492] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: No bootstrap required, opened a new log
I20260809 02:21:19.313297 13415 ts_tablet_manager.cc:1397] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:19.313341 13414 raft_consensus.cc:348] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.313453 13414 raft_consensus.cc:374] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.313491 13414 raft_consensus.cc:729] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176183f09b3f483ab086609efc4b091d, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.313607 13414 consensus_queue.cc:260] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.313714 13415 raft_consensus.cc:348] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.313814 13415 raft_consensus.cc:374] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.313841 13415 raft_consensus.cc:729] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6b2171f02b425896f65b8053c8e1a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.313866 13414 ts_tablet_manager.cc:1428] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:19.313944 13415 consensus_queue.cc:260] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.314173 13415 ts_tablet_manager.cc:1428] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:19.314344 13450 ts_tablet_manager.cc:1918] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:19.314436 13450 log.cc:1196] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/cc920251117947598a41d9432961bebd
I20260809 02:21:19.314764 13450 ts_tablet_manager.cc:1939] T cc920251117947598a41d9432961bebd P 176183f09b3f483ab086609efc4b091d: Deleting consensus metadata
I20260809 02:21:19.315919 12599 catalog_manager.cc:4841] TS 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409): tablet cc920251117947598a41d9432961bebd (table test-table [id=0d29b04adeaa492c8c58c39e0d30a628]) successfully deleted
I20260809 02:21:19.318120 13453 ts_tablet_manager.cc:1918] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:19.318207 13453 log.cc:1196] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/cc920251117947598a41d9432961bebd
I20260809 02:21:19.318492 13453 ts_tablet_manager.cc:1939] T cc920251117947598a41d9432961bebd P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting consensus metadata
I20260809 02:21:19.319370 12606 catalog_manager.cc:4841] TS c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731): tablet cc920251117947598a41d9432961bebd (table test-table [id=0d29b04adeaa492c8c58c39e0d30a628]) successfully deleted
I20260809 02:21:19.319710 13452 tablet_replica.cc:330] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: stopping tablet replica
I20260809 02:21:19.319963 13416 tablet_bootstrap.cc:492] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: No bootstrap required, opened a new log
I20260809 02:21:19.320050 13416 ts_tablet_manager.cc:1397] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20260809 02:21:19.320039 13452 raft_consensus.cc:2229] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:19.320390 13452 raft_consensus.cc:2258] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:19.320587 13416 raft_consensus.cc:348] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.320703 13416 raft_consensus.cc:374] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.320735 13416 raft_consensus.cc:729] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6fdec68fd8b4bd2ab0af592ef7d88a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.320858 13416 consensus_queue.cc:260] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.321112 13416 ts_tablet_manager.cc:1428] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:19.321889 13452 ts_tablet_manager.cc:1905] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:19.324313 13452 ts_tablet_manager.cc:1918] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:19.324409 13452 log.cc:1196] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/cc920251117947598a41d9432961bebd
I20260809 02:21:19.324694 13452 ts_tablet_manager.cc:1939] T cc920251117947598a41d9432961bebd P 3a6b2171f02b425896f65b8053c8e1a7: Deleting consensus metadata
I20260809 02:21:19.325577 12606 catalog_manager.cc:4841] TS 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163): tablet cc920251117947598a41d9432961bebd (table test-table [id=0d29b04adeaa492c8c58c39e0d30a628]) successfully deleted
I20260809 02:21:19.516610 13421 raft_consensus.cc:482] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:19.516754 13421 raft_consensus.cc:504] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.517777 13421 leader_election.cc:288] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731), 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163)
I20260809 02:21:19.522540 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.518119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:54533 (local address 127.1.81.193:44731)
0809 02:21:19.518275 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.518280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.518379 (+ 99us) server_negotiation.cc:407] Connection header received
0809 02:21:19.518546 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.518549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.518601 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.518680 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:19.518963 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.519708 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.521278 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.521873 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.521989 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.522043 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.522348 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.522417 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:21:19.522540 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.518498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:51983 (local address 127.1.81.195:34163)
0809 02:21:19.518612 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.518617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.518827 (+ 210us) server_negotiation.cc:407] Connection header received
0809 02:21:19.518915 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.518918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.518967 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.519034 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:19.519254 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.519953 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.521270 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.521873 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.521989 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.522043 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.522348 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.522417 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 02:21:19.522614 13460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.518409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:34163 (local address 127.1.81.194:51983)
0809 02:21:19.518736 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.518749 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.518839 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.519055 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.519057 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.519072 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:19.519166 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.519171 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.520037 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.520040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.521173 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.521180 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.522003 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.522008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.522205 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.522249 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.522327 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.522431 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":84,"thread_start_us":89,"threads_started":1}
I20260809 02:21:19.522773 13459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.518047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:44731 (local address 127.1.81.194:54533)
0809 02:21:19.518283 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.518296 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.518419 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.518700 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.518703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.518722 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:19.518866 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.518872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.519843 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.519847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.521159 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.521172 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.522003 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.522008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.522225 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.522262 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.522327 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.522431 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":83,"thread_start_us":63,"threads_started":1}
I20260809 02:21:19.523104 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2395a753239f4508a0029b9bdde42212" candidate_uuid: "176183f09b3f483ab086609efc4b091d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6b2171f02b425896f65b8053c8e1a7" is_pre_election: true
I20260809 02:21:19.523242 13306 raft_consensus.cc:2454] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 176183f09b3f483ab086609efc4b091d in term 0.
I20260809 02:21:19.523245 12869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2395a753239f4508a0029b9bdde42212" candidate_uuid: "176183f09b3f483ab086609efc4b091d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" is_pre_election: true
I20260809 02:21:19.523454 12869 raft_consensus.cc:2454] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 176183f09b3f483ab086609efc4b091d in term 0.
I20260809 02:21:19.523587 12994 leader_election.cc:302] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176183f09b3f483ab086609efc4b091d, 3a6b2171f02b425896f65b8053c8e1a7; no voters:
I20260809 02:21:19.523852 13421 raft_consensus.cc:2781] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:19.523916 13421 raft_consensus.cc:482] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:19.523957 13421 raft_consensus.cc:3037] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.524902 13421 raft_consensus.cc:504] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.525202 13421 leader_election.cc:288] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [CANDIDATE]: Term 1 election: Requested vote from peers c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731), 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163)
I20260809 02:21:19.525544 12869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2395a753239f4508a0029b9bdde42212" candidate_uuid: "176183f09b3f483ab086609efc4b091d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7"
I20260809 02:21:19.525671 12869 raft_consensus.cc:3037] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.525628 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2395a753239f4508a0029b9bdde42212" candidate_uuid: "176183f09b3f483ab086609efc4b091d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6b2171f02b425896f65b8053c8e1a7"
I20260809 02:21:19.525751 13306 raft_consensus.cc:3037] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.526556 12869 raft_consensus.cc:2454] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 176183f09b3f483ab086609efc4b091d in term 1.
I20260809 02:21:19.526574 13306 raft_consensus.cc:2454] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 176183f09b3f483ab086609efc4b091d in term 1.
I20260809 02:21:19.526815 12994 leader_election.cc:302] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176183f09b3f483ab086609efc4b091d, c6fdec68fd8b4bd2ab0af592ef7d88a7; no voters:
I20260809 02:21:19.527010 13421 raft_consensus.cc:2781] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:19.527211 13421 raft_consensus.cc:686] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 1 LEADER]: Becoming Leader. State: Replica: 176183f09b3f483ab086609efc4b091d, State: Running, Role: LEADER
I20260809 02:21:19.527436 13421 consensus_queue.cc:237] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.529568 12623 catalog_manager.cc:5495] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d reported cstate change: term changed from 0 to 1, leader changed from <none> to 176183f09b3f483ab086609efc4b091d (127.1.81.194). New cstate: current_term: 1 leader_uuid: "176183f09b3f483ab086609efc4b091d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:21:19 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242078, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.254@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:19.564606 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.557071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36555 (local address 127.0.0.1:35842)
0809 02:21:19.557317 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.557331 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.557407 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.557603 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.557605 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.557985 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:19.558072 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.558078 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.558833 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.558835 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.559379 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.559385 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.559787 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.559789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.559872 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.560348 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:19.560359 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:19.561716 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:19.563113 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:19.563122 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:19.563129 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:19.563350 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:19.563598 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:19.563601 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:19.563603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:19.563680 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:19.564055 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:19.564062 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:19.564172 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.564266 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.564415 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":72,"threads_started":1}
I20260809 02:21:19.564605 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.557144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35842 (local address 127.1.81.254:36555)
0809 02:21:19.557384 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.557390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.557402 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:19.557475 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.557477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.557512 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.557581 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:19.558171 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.558750 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.559475 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.559711 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.559780 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.561835 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:19.561838 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:19.561840 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:19.561860 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:19.563017 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:19.563438 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:19.563442 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:19.563443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:19.563520 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:19.563758 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:19.563761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:19.563762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:19.563959 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:19.564045 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.564327 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.564470 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":182,"thread_start_us":96,"threads_started":1}
I20260809 02:21:19.567945 12623 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:35842:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:21:19.568576 12623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:19.572921 12837 tablet_service.cc:1467] Processing CreateTablet for tablet 9269ff6a777048f68b70185f4b270904 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8714bdf14490478b89d3483e3f552ad7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:21:19.573066 13065 tablet_service.cc:1467] Processing CreateTablet for tablet 9269ff6a777048f68b70185f4b270904 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8714bdf14490478b89d3483e3f552ad7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:21:19.573092 13278 tablet_service.cc:1467] Processing CreateTablet for tablet 9269ff6a777048f68b70185f4b270904 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8714bdf14490478b89d3483e3f552ad7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:21:19.573331 12837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9269ff6a777048f68b70185f4b270904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.573386 13065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9269ff6a777048f68b70185f4b270904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.573489 13278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9269ff6a777048f68b70185f4b270904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.575783 13415 tablet_bootstrap.cc:492] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: Bootstrap starting.
I20260809 02:21:19.576110 13416 tablet_bootstrap.cc:492] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Bootstrap starting.
I20260809 02:21:19.576370 13414 tablet_bootstrap.cc:492] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: Bootstrap starting.
I20260809 02:21:19.576764 13415 tablet_bootstrap.cc:654] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.576858 13416 tablet_bootstrap.cc:654] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.577353 13414 tablet_bootstrap.cc:654] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.578075 13415 tablet_bootstrap.cc:492] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: No bootstrap required, opened a new log
I20260809 02:21:19.578169 13415 ts_tablet_manager.cc:1397] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:21:19.578606 13414 tablet_bootstrap.cc:492] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: No bootstrap required, opened a new log
I20260809 02:21:19.578614 13415 raft_consensus.cc:348] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.578714 13414 ts_tablet_manager.cc:1397] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260809 02:21:19.578720 13415 raft_consensus.cc:374] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.578754 13415 raft_consensus.cc:729] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6b2171f02b425896f65b8053c8e1a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.578824 13416 tablet_bootstrap.cc:492] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: No bootstrap required, opened a new log
I20260809 02:21:19.578896 13416 ts_tablet_manager.cc:1397] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 02:21:19.578874 13415 consensus_queue.cc:260] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.579149 13415 ts_tablet_manager.cc:1428] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:21:19.579118 13414 raft_consensus.cc:348] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.579227 13414 raft_consensus.cc:374] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.579252 13414 raft_consensus.cc:729] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176183f09b3f483ab086609efc4b091d, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.579348 13414 consensus_queue.cc:260] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.579331 13416 raft_consensus.cc:348] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.579336 13424 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.579437 13416 raft_consensus.cc:374] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.579464 13424 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:21:19.579468 13416 raft_consensus.cc:729] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6fdec68fd8b4bd2ab0af592ef7d88a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.579597 13414 ts_tablet_manager.cc:1428] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:19.579564 13421 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.579595 13416 consensus_queue.cc:260] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.579694 13421 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:21:19.579890 13416 ts_tablet_manager.cc:1428] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260809 02:21:19.580255 13423 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.580379 13423 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:21:19.782594 13424 raft_consensus.cc:482] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:19.782744 13424 raft_consensus.cc:504] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.783830 13424 leader_election.cc:288] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731), 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409)
I20260809 02:21:19.788970 13484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.784153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:56487 (local address 127.1.81.194:37409)
0809 02:21:19.784473 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.784477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.784536 (+ 59us) server_negotiation.cc:407] Connection header received
0809 02:21:19.784634 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.784636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.784687 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.784766 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:19.785145 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.785941 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.787688 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.788331 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.788453 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.788505 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.788764 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.788837 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":71,"threads_started":1}
I20260809 02:21:19.788967 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.784236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:48877 (local address 127.1.81.193:44731)
0809 02:21:19.784365 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.784370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.784465 (+ 95us) server_negotiation.cc:407] Connection header received
0809 02:21:19.784614 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.784617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.784675 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.784769 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:19.785152 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.785940 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.787688 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.788331 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.788453 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.788505 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.788764 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.788836 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:21:19.789034 13482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.784038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:37409 (local address 127.1.81.195:56487)
0809 02:21:19.784468 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.784480 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.784554 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.784779 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.784781 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.784823 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:19.785034 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.785040 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.786038 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.786041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.787570 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.787583 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.788446 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.788450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.788618 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.788666 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.788729 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.788838 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":231,"spinlock_wait_cycles":3968,"thread_start_us":65,"threads_started":1}
I20260809 02:21:19.789034 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.784038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:44731 (local address 127.1.81.195:48877)
0809 02:21:19.784374 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.784389 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.784508 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.784778 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.784781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.784821 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:19.785028 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.785036 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.786038 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.786041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.787570 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.787583 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.788446 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.788450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.788632 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.788657 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.788729 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.788840 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":214,"spinlock_wait_cycles":31744,"thread_start_us":80,"threads_started":1}
I20260809 02:21:19.789546 12869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9269ff6a777048f68b70185f4b270904" candidate_uuid: "3a6b2171f02b425896f65b8053c8e1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" is_pre_election: true
I20260809 02:21:19.789587 13097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9269ff6a777048f68b70185f4b270904" candidate_uuid: "3a6b2171f02b425896f65b8053c8e1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176183f09b3f483ab086609efc4b091d" is_pre_election: true
I20260809 02:21:19.789716 13097 raft_consensus.cc:2454] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a6b2171f02b425896f65b8053c8e1a7 in term 0.
I20260809 02:21:19.789716 12869 raft_consensus.cc:2454] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a6b2171f02b425896f65b8053c8e1a7 in term 0.
I20260809 02:21:19.790118 13199 leader_election.cc:302] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 176183f09b3f483ab086609efc4b091d, 3a6b2171f02b425896f65b8053c8e1a7, c6fdec68fd8b4bd2ab0af592ef7d88a7; no voters:
I20260809 02:21:19.790367 13424 raft_consensus.cc:2781] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:19.790429 13424 raft_consensus.cc:482] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:19.790475 13424 raft_consensus.cc:3037] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.791435 13424 raft_consensus.cc:504] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.791781 13424 leader_election.cc:288] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [CANDIDATE]: Term 1 election: Requested vote from peers c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731), 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409)
I20260809 02:21:19.792128 13097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9269ff6a777048f68b70185f4b270904" candidate_uuid: "3a6b2171f02b425896f65b8053c8e1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176183f09b3f483ab086609efc4b091d"
I20260809 02:21:19.792241 13097 raft_consensus.cc:3037] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.793083 13097 raft_consensus.cc:2454] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a6b2171f02b425896f65b8053c8e1a7 in term 1.
I20260809 02:21:19.793318 12869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9269ff6a777048f68b70185f4b270904" candidate_uuid: "3a6b2171f02b425896f65b8053c8e1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7"
I20260809 02:21:19.793365 13199 leader_election.cc:302] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176183f09b3f483ab086609efc4b091d, 3a6b2171f02b425896f65b8053c8e1a7; no voters:
I20260809 02:21:19.793428 12869 raft_consensus.cc:3037] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:19.793534 13424 raft_consensus.cc:2781] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:19.793725 13424 raft_consensus.cc:686] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 LEADER]: Becoming Leader. State: Replica: 3a6b2171f02b425896f65b8053c8e1a7, State: Running, Role: LEADER
I20260809 02:21:19.793962 13424 consensus_queue.cc:237] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.794557 12869 raft_consensus.cc:2454] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a6b2171f02b425896f65b8053c8e1a7 in term 1.
I20260809 02:21:19.795234 13486 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: TxnStatusTablet state changed. Reason: New leader 3a6b2171f02b425896f65b8053c8e1a7. Latest consensus state: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.795405 13486 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:21:19.795650 13489 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:21:19.795818 13489 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:21:19.796378 12621 catalog_manager.cc:5495] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195). New cstate: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } health_report { overall_health: HEALTHY } } }
I20260809 02:21:19.816143 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.812814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42488 (local address 127.1.81.195:34163)
0809 02:21:19.812917 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.812921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.812934 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:19.813115 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.813118 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.813169 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.813246 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:19.813471 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.813950 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.814756 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.814965 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.815048 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.815351 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:19.815748 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:19.815883 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.815953 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.816002 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:21:19.816154 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.812727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:34163 (local address 127.0.0.1:42488)
0809 02:21:19.812872 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.812887 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.812988 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.813272 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.813275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.813283 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:21:19.813378 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.813383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.814051 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.814054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.814648 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.814657 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.815060 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.815063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.815162 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.815217 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:21:19.815858 (+ 641us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:21:19.815876 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.815942 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.816031 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:21:19.818876 13097 raft_consensus.cc:1261] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Refusing update from remote peer 3a6b2171f02b425896f65b8053c8e1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:19.819114 12869 raft_consensus.cc:1261] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Refusing update from remote peer 3a6b2171f02b425896f65b8053c8e1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:19.819319 13424 consensus_queue.cc:1035] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:19.819578 13486 consensus_queue.cc:1035] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:19.820818 13421 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: TxnStatusTablet state changed. Reason: New leader 3a6b2171f02b425896f65b8053c8e1a7. Latest consensus state: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.820931 13421 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:21:19.821246 13423 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: TxnStatusTablet state changed. Reason: New leader 3a6b2171f02b425896f65b8053c8e1a7. Latest consensus state: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.821344 13423 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:21:19.822952 13486 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.823066 13486 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:21:19.823179 13486 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.823246 13486 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P 3a6b2171f02b425896f65b8053c8e1a7: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:21:19.823690 13423 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.823789 13423 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P c6fdec68fd8b4bd2ab0af592ef7d88a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:21:19.824723 13421 tablet_replica.cc:439] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } } }
I20260809 02:21:19.824831 13421 tablet_replica.cc:442] T 9269ff6a777048f68b70185f4b270904 P 176183f09b3f483ab086609efc4b091d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:21:19.826138 13492 mvcc.cc:205] Tried to move back new op lower bound from 7316447558933983232 to 7316447558838874112. Current Snapshot: MvccSnapshot[applied={T|T < 7316447558933983232 or (T in {7316447558933983232})}]
I20260809 02:21:19.826725 13493 mvcc.cc:205] Tried to move back new op lower bound from 7316447558933983232 to 7316447558838874112. Current Snapshot: MvccSnapshot[applied={T|T < 7316447558933983232}]
I20260809 02:21:19.827664 13497 mvcc.cc:205] Tried to move back new op lower bound from 7316447558933983232 to 7316447558838874112. Current Snapshot: MvccSnapshot[applied={T|T < 7316447558933983232}]
I20260809 02:21:19.836035 13484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.832393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56780 (local address 127.1.81.194:37409)
0809 02:21:19.832513 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.832517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.832688 (+ 171us) server_negotiation.cc:407] Connection header received
0809 02:21:19.832832 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.832834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.832887 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.832961 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:19.833196 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.833651 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.834811 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.835005 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.835067 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.835323 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:19.835683 (+ 360us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:19.835761 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.835887 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.835933 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:21:19.845567 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.842413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:41219 (local address 127.1.81.195:34163)
0809 02:21:19.842513 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.842517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.842691 (+ 174us) server_negotiation.cc:407] Connection header received
0809 02:21:19.842816 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.842819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.842861 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.842915 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:19.843165 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.843688 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.844628 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.844838 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.844921 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.845177 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:19.845241 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:19.845299 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.845402 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.845445 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:21:19.845592 13510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.842342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:34163 (local address 127.1.81.194:41219)
0809 02:21:19.842608 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.842619 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.842719 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.842932 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.842934 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.842941 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:21:19.843042 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.843047 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.843788 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.843791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.844520 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.844531 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.844938 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.844941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.845015 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.845054 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:21:19.845320 (+ 266us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:21:19.845326 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.845384 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.845458 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":83,"threads_started":1}
I20260809 02:21:19.851722 12869 raft_consensus.cc:1261] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Refusing update from remote peer 176183f09b3f483ab086609efc4b091d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:19.851730 13306 raft_consensus.cc:1261] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Refusing update from remote peer 176183f09b3f483ab086609efc4b091d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:19.852202 13421 consensus_queue.cc:1035] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:19.852385 13461 consensus_queue.cc:1035] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:19.873796 13484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.870483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:39349 (local address 127.1.81.194:37409)
0809 02:21:19.870582 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.870586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.870785 (+ 199us) server_negotiation.cc:407] Connection header received
0809 02:21:19.870889 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.870892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.870932 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.870990 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:19.871210 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.871829 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.872853 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.873067 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.873155 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.873428 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:19.873493 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:19.873546 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.873639 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.873682 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:21:19.873839 13516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.870418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:37409 (local address 127.1.81.195:39349)
0809 02:21:19.870711 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:19.870722 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:19.870816 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:19.871006 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:19.871008 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:19.871016 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:21:19.871119 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.871124 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.871917 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.871920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.872744 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:19.872754 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.873160 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.873163 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:19.873268 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.873309 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:21:19.873564 (+ 255us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:21:19.873571 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 02:21:19.873628 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 02:21:19.873710 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":95,"threads_started":1}
I20260809 02:21:19.898900 12623 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:19.899037 12623 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:19.900877 12623 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: Sending DeleteTablet for 3 replicas of tablet 2395a753239f4508a0029b9bdde42212
I20260809 02:21:19.901387 13278 tablet_service.cc:1514] Processing DeleteTablet for tablet 2395a753239f4508a0029b9bdde42212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:19 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42474
I20260809 02:21:19.901706 13519 tablet_replica.cc:330] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: stopping tablet replica
I20260809 02:21:19.901690 13065 tablet_service.cc:1514] Processing DeleteTablet for tablet 2395a753239f4508a0029b9bdde42212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:19 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:56776
I20260809 02:21:19.901919 13519 raft_consensus.cc:2229] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:19.902079 13519 raft_consensus.cc:2258] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:19.902064 12837 tablet_service.cc:1514] Processing DeleteTablet for tablet 2395a753239f4508a0029b9bdde42212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:19 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58436
I20260809 02:21:19.902869 13519 ts_tablet_manager.cc:1905] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:19.905844 13519 ts_tablet_manager.cc:1918] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:21:19.905993 13519 log.cc:1196] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/2395a753239f4508a0029b9bdde42212
I20260809 02:21:19.906944 13519 ts_tablet_manager.cc:1939] T 2395a753239f4508a0029b9bdde42212 P 3a6b2171f02b425896f65b8053c8e1a7: Deleting consensus metadata
I20260809 02:21:19.907441 13522 tablet_replica.cc:330] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: stopping tablet replica
I20260809 02:21:19.907841 13522 raft_consensus.cc:2229] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:19.908207 13522 raft_consensus.cc:2258] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:19.908244 12606 catalog_manager.cc:4841] TS 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163): tablet 2395a753239f4508a0029b9bdde42212 (table test-table [id=eed628eaacb54d41800f47ee6f2bfe16]) successfully deleted
I20260809 02:21:19.908874 13522 ts_tablet_manager.cc:1905] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:19.910285 13521 tablet_replica.cc:330] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: stopping tablet replica
I20260809 02:21:19.910413 13521 raft_consensus.cc:2229] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:19.910744 13521 raft_consensus.cc:2258] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:19.911981 13522 ts_tablet_manager.cc:1918] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:21:19.912083 13521 ts_tablet_manager.cc:1905] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:19.912108 13522 log.cc:1196] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/2395a753239f4508a0029b9bdde42212
I20260809 02:21:19.912622 13522 ts_tablet_manager.cc:1939] T 2395a753239f4508a0029b9bdde42212 P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting consensus metadata
I20260809 02:21:19.913276 12606 catalog_manager.cc:4841] TS c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731): tablet 2395a753239f4508a0029b9bdde42212 (table test-table [id=eed628eaacb54d41800f47ee6f2bfe16]) successfully deleted
I20260809 02:21:19.914487 13521 ts_tablet_manager.cc:1918] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:21:19.914556 13521 log.cc:1196] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/2395a753239f4508a0029b9bdde42212
I20260809 02:21:19.914769 13521 ts_tablet_manager.cc:1939] T 2395a753239f4508a0029b9bdde42212 P 176183f09b3f483ab086609efc4b091d: Deleting consensus metadata
I20260809 02:21:19.915343 12599 catalog_manager.cc:4841] TS 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409): tablet 2395a753239f4508a0029b9bdde42212 (table test-table [id=eed628eaacb54d41800f47ee6f2bfe16]) successfully deleted
Aug 09 02:21:19 dist-test-slave-jlzn krb5kdc[12555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:21:19 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:19 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:21:19.935070 13477 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:19.929050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35848 (local address 127.1.81.254:36555)
0809 02:21:19.929179 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.929184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.929405 (+ 221us) server_negotiation.cc:407] Connection header received
0809 02:21:19.929528 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.929531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.929573 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.929635 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:19.930330 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.930860 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.931702 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.931971 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.932058 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.934955 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35848: BlockingRecv error: recv got EOF from 127.0.0.1:35848 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 02:21:19 dist-test-slave-jlzn krb5kdc[12555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM
I20260809 02:21:19.957188 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:19.944175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35864 (local address 127.1.81.254:36555)
0809 02:21:19.944267 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:19.944271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:19.948043 (+ 3772us) server_negotiation.cc:407] Connection header received
0809 02:21:19.948205 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:19.948209 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:19.948250 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:19.948294 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:19.949055 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.949852 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.951002 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:19.951341 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:19.951404 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:19.954098 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:19.954103 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:19.954106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:19.954130 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:19.955652 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:19.956066 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:19.956070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:19.956072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:19.956157 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:19.956407 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:19.956410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:19.956412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:19.956578 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:19.956694 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:19.956934 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 02:21:19.957044 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:21:19.959766 12623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35864:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:19.960232 12623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:19.964977 12837 tablet_service.cc:1467] Processing CreateTablet for tablet 439d83ba1b154dae9b84d0f9389ec40f (DEFAULT_TABLE table=test-table [id=b48d82f5572845e69389feb524f6a28c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:19.965271 12837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 439d83ba1b154dae9b84d0f9389ec40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.967121 13416 tablet_bootstrap.cc:492] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: Bootstrap starting.
I20260809 02:21:19.967329 13065 tablet_service.cc:1467] Processing CreateTablet for tablet 439d83ba1b154dae9b84d0f9389ec40f (DEFAULT_TABLE table=test-table [id=b48d82f5572845e69389feb524f6a28c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:19.967581 13065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 439d83ba1b154dae9b84d0f9389ec40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.968106 13416 tablet_bootstrap.cc:654] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.969681 13414 tablet_bootstrap.cc:492] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: Bootstrap starting.
I20260809 02:21:19.970220 13278 tablet_service.cc:1467] Processing CreateTablet for tablet 439d83ba1b154dae9b84d0f9389ec40f (DEFAULT_TABLE table=test-table [id=b48d82f5572845e69389feb524f6a28c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:19.970476 13278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 439d83ba1b154dae9b84d0f9389ec40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:19.970556 13414 tablet_bootstrap.cc:654] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.972056 13414 tablet_bootstrap.cc:492] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: No bootstrap required, opened a new log
I20260809 02:21:19.972138 13414 ts_tablet_manager.cc:1397] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 02:21:19.972553 13414 raft_consensus.cc:348] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.972679 13414 raft_consensus.cc:374] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.972713 13414 raft_consensus.cc:729] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176183f09b3f483ab086609efc4b091d, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.972829 13414 consensus_queue.cc:260] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.972923 13415 tablet_bootstrap.cc:492] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: Bootstrap starting.
I20260809 02:21:19.973093 13414 ts_tablet_manager.cc:1428] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:21:19.973686 13415 tablet_bootstrap.cc:654] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:19.974645 13415 tablet_bootstrap.cc:492] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: No bootstrap required, opened a new log
I20260809 02:21:19.974735 13415 ts_tablet_manager.cc:1397] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:21:19.975171 13416 tablet_bootstrap.cc:492] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: No bootstrap required, opened a new log
I20260809 02:21:19.975114 13415 raft_consensus.cc:348] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.975224 13415 raft_consensus.cc:374] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.975252 13415 raft_consensus.cc:729] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6b2171f02b425896f65b8053c8e1a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.975257 13416 ts_tablet_manager.cc:1397] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260809 02:21:19.975366 13415 consensus_queue.cc:260] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.975598 13415 ts_tablet_manager.cc:1428] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:19.975656 13416 raft_consensus.cc:348] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.975776 13416 raft_consensus.cc:374] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:19.975841 13416 raft_consensus.cc:729] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6fdec68fd8b4bd2ab0af592ef7d88a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:19.975960 13416 consensus_queue.cc:260] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:19.976220 13416 ts_tablet_manager.cc:1428] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:20.123956 13511 raft_consensus.cc:482] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:20.124123 13511 raft_consensus.cc:504] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.124547 13511 leader_election.cc:288] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731), 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409)
I20260809 02:21:20.124969 13097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "439d83ba1b154dae9b84d0f9389ec40f" candidate_uuid: "3a6b2171f02b425896f65b8053c8e1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176183f09b3f483ab086609efc4b091d" is_pre_election: true
I20260809 02:21:20.124969 12869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "439d83ba1b154dae9b84d0f9389ec40f" candidate_uuid: "3a6b2171f02b425896f65b8053c8e1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" is_pre_election: true
I20260809 02:21:20.125121 13097 raft_consensus.cc:2454] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a6b2171f02b425896f65b8053c8e1a7 in term 0.
I20260809 02:21:20.125119 12869 raft_consensus.cc:2454] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a6b2171f02b425896f65b8053c8e1a7 in term 0.
I20260809 02:21:20.125459 13204 leader_election.cc:302] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a6b2171f02b425896f65b8053c8e1a7, c6fdec68fd8b4bd2ab0af592ef7d88a7; no voters:
I20260809 02:21:20.125653 13511 raft_consensus.cc:2781] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:20.125716 13511 raft_consensus.cc:482] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:20.125743 13511 raft_consensus.cc:3037] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:20.126792 13511 raft_consensus.cc:504] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.127108 13511 leader_election.cc:288] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [CANDIDATE]: Term 1 election: Requested vote from peers c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731), 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409)
I20260809 02:21:20.127444 12869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "439d83ba1b154dae9b84d0f9389ec40f" candidate_uuid: "3a6b2171f02b425896f65b8053c8e1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7"
I20260809 02:21:20.127487 13097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "439d83ba1b154dae9b84d0f9389ec40f" candidate_uuid: "3a6b2171f02b425896f65b8053c8e1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176183f09b3f483ab086609efc4b091d"
I20260809 02:21:20.127580 12869 raft_consensus.cc:3037] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:20.127592 13097 raft_consensus.cc:3037] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:20.128760 13097 raft_consensus.cc:2454] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a6b2171f02b425896f65b8053c8e1a7 in term 1.
I20260809 02:21:20.128845 12869 raft_consensus.cc:2454] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a6b2171f02b425896f65b8053c8e1a7 in term 1.
I20260809 02:21:20.129072 13199 leader_election.cc:302] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 176183f09b3f483ab086609efc4b091d, 3a6b2171f02b425896f65b8053c8e1a7, c6fdec68fd8b4bd2ab0af592ef7d88a7; no voters:
I20260809 02:21:20.129256 13511 raft_consensus.cc:2781] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:20.129343 13511 raft_consensus.cc:686] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 LEADER]: Becoming Leader. State: Replica: 3a6b2171f02b425896f65b8053c8e1a7, State: Running, Role: LEADER
I20260809 02:21:20.129480 13511 consensus_queue.cc:237] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.131011 12620 catalog_manager.cc:5495] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195). New cstate: current_term: 1 leader_uuid: "3a6b2171f02b425896f65b8053c8e1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } health_report { overall_health: HEALTHY } } }
I20260809 02:21:20.164710 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:20.161762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42500 (local address 127.1.81.195:34163)
0809 02:21:20.161887 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:20.161892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:20.161905 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:20.161999 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:20.162002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:20.162047 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:20.162105 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:20.162365 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.162862 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.163706 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.163948 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.164037 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:20.164305 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:20.164375 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:20.164431 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:20.164524 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 02:21:20.164575 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:20.166790 12869 raft_consensus.cc:1261] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Refusing update from remote peer 3a6b2171f02b425896f65b8053c8e1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:20.166821 13097 raft_consensus.cc:1261] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Refusing update from remote peer 3a6b2171f02b425896f65b8053c8e1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:20.167218 13511 consensus_queue.cc:1035] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:20.167383 13486 consensus_queue.cc:1035] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:20.176396 12620 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:20.176512 12620 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:20.178320 12620 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: Sending DeleteTablet for 3 replicas of tablet 439d83ba1b154dae9b84d0f9389ec40f
I20260809 02:21:20.178817 12837 tablet_service.cc:1514] Processing DeleteTablet for tablet 439d83ba1b154dae9b84d0f9389ec40f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:20 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58436
I20260809 02:21:20.178850 13065 tablet_service.cc:1514] Processing DeleteTablet for tablet 439d83ba1b154dae9b84d0f9389ec40f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:20 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:56776
I20260809 02:21:20.179028 13521 tablet_replica.cc:330] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: stopping tablet replica
I20260809 02:21:20.179042 13522 tablet_replica.cc:330] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: stopping tablet replica
I20260809 02:21:20.179028 13278 tablet_service.cc:1514] Processing DeleteTablet for tablet 439d83ba1b154dae9b84d0f9389ec40f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:20 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42474
I20260809 02:21:20.179162 13522 raft_consensus.cc:2229] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:20.179158 13521 raft_consensus.cc:2229] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:20.179183 13519 tablet_replica.cc:330] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: stopping tablet replica
I20260809 02:21:20.179270 13519 raft_consensus.cc:2229] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:20.179276 13522 raft_consensus.cc:2258] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:20.179272 13521 raft_consensus.cc:2258] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:20.179553 13519 raft_consensus.cc:2258] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:20.180023 13521 ts_tablet_manager.cc:1905] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:20.180140 13522 ts_tablet_manager.cc:1905] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:20.180251 13519 ts_tablet_manager.cc:1905] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:20.182495 13521 ts_tablet_manager.cc:1918] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:20.182495 13519 ts_tablet_manager.cc:1918] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:20.182525 13522 ts_tablet_manager.cc:1918] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:20.182564 13519 log.cc:1196] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/439d83ba1b154dae9b84d0f9389ec40f
I20260809 02:21:20.182564 13521 log.cc:1196] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/439d83ba1b154dae9b84d0f9389ec40f
I20260809 02:21:20.182591 13522 log.cc:1196] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/439d83ba1b154dae9b84d0f9389ec40f
I20260809 02:21:20.182819 13521 ts_tablet_manager.cc:1939] T 439d83ba1b154dae9b84d0f9389ec40f P 176183f09b3f483ab086609efc4b091d: Deleting consensus metadata
I20260809 02:21:20.182843 13522 ts_tablet_manager.cc:1939] T 439d83ba1b154dae9b84d0f9389ec40f P c6fdec68fd8b4bd2ab0af592ef7d88a7: Deleting consensus metadata
I20260809 02:21:20.182845 13519 ts_tablet_manager.cc:1939] T 439d83ba1b154dae9b84d0f9389ec40f P 3a6b2171f02b425896f65b8053c8e1a7: Deleting consensus metadata
I20260809 02:21:20.183476 12606 catalog_manager.cc:4841] TS c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731): tablet 439d83ba1b154dae9b84d0f9389ec40f (table test-table [id=b48d82f5572845e69389feb524f6a28c]) successfully deleted
I20260809 02:21:20.183514 12599 catalog_manager.cc:4841] TS 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409): tablet 439d83ba1b154dae9b84d0f9389ec40f (table test-table [id=b48d82f5572845e69389feb524f6a28c]) successfully deleted
I20260809 02:21:20.183797 12606 catalog_manager.cc:4841] TS 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163): tablet 439d83ba1b154dae9b84d0f9389ec40f (table test-table [id=b48d82f5572845e69389feb524f6a28c]) successfully deleted
I20260809 02:21:20.184490 12620 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35864:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:20.184861 12620 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:20.188843 12837 tablet_service.cc:1467] Processing CreateTablet for tablet e9377bf41d1c486f96652bfbede66cdc (DEFAULT_TABLE table=test-table [id=53dc9b57a0564638b6e639a3c381d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:20.188994 13278 tablet_service.cc:1467] Processing CreateTablet for tablet e9377bf41d1c486f96652bfbede66cdc (DEFAULT_TABLE table=test-table [id=53dc9b57a0564638b6e639a3c381d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:20.189085 12837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9377bf41d1c486f96652bfbede66cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:20.189255 13278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9377bf41d1c486f96652bfbede66cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:20.191059 13415 tablet_bootstrap.cc:492] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: Bootstrap starting.
I20260809 02:21:20.191314 13065 tablet_service.cc:1467] Processing CreateTablet for tablet e9377bf41d1c486f96652bfbede66cdc (DEFAULT_TABLE table=test-table [id=53dc9b57a0564638b6e639a3c381d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:20.191546 13065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9377bf41d1c486f96652bfbede66cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:20.191850 13415 tablet_bootstrap.cc:654] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:20.192778 13415 tablet_bootstrap.cc:492] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: No bootstrap required, opened a new log
I20260809 02:21:20.192859 13415 ts_tablet_manager.cc:1397] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:20.193185 13415 raft_consensus.cc:348] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.193282 13415 raft_consensus.cc:374] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:20.193318 13415 raft_consensus.cc:729] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6b2171f02b425896f65b8053c8e1a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:20.193427 13415 consensus_queue.cc:260] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.193658 13415 ts_tablet_manager.cc:1428] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:20.193749 13416 tablet_bootstrap.cc:492] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7: Bootstrap starting.
I20260809 02:21:20.194480 13416 tablet_bootstrap.cc:654] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:20.195029 13414 tablet_bootstrap.cc:492] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: Bootstrap starting.
I20260809 02:21:20.195792 13414 tablet_bootstrap.cc:654] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:20.196748 13414 tablet_bootstrap.cc:492] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: No bootstrap required, opened a new log
I20260809 02:21:20.196817 13414 ts_tablet_manager.cc:1397] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:21:20.196882 13416 tablet_bootstrap.cc:492] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7: No bootstrap required, opened a new log
I20260809 02:21:20.196962 13416 ts_tablet_manager.cc:1397] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 02:21:20.197171 13414 raft_consensus.cc:348] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.197268 13414 raft_consensus.cc:374] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:20.197296 13414 raft_consensus.cc:729] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176183f09b3f483ab086609efc4b091d, State: Initialized, Role: FOLLOWER
I20260809 02:21:20.197342 13416 raft_consensus.cc:348] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.197443 13416 raft_consensus.cc:374] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:20.197407 13414 consensus_queue.cc:260] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.197469 13416 raft_consensus.cc:729] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6fdec68fd8b4bd2ab0af592ef7d88a7, State: Initialized, Role: FOLLOWER
I20260809 02:21:20.197569 13416 consensus_queue.cc:260] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.197652 13414 ts_tablet_manager.cc:1428] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:20.197832 13416 ts_tablet_manager.cc:1428] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:20.404109 13423 raft_consensus.cc:482] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:20.404250 13423 raft_consensus.cc:504] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.404640 13423 leader_election.cc:288] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409), 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163)
I20260809 02:21:20.405045 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9377bf41d1c486f96652bfbede66cdc" candidate_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6b2171f02b425896f65b8053c8e1a7" is_pre_election: true
I20260809 02:21:20.405069 13097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9377bf41d1c486f96652bfbede66cdc" candidate_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176183f09b3f483ab086609efc4b091d" is_pre_election: true
I20260809 02:21:20.405192 13306 raft_consensus.cc:2454] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6fdec68fd8b4bd2ab0af592ef7d88a7 in term 0.
I20260809 02:21:20.405230 13097 raft_consensus.cc:2454] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6fdec68fd8b4bd2ab0af592ef7d88a7 in term 0.
I20260809 02:21:20.405511 12754 leader_election.cc:302] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a6b2171f02b425896f65b8053c8e1a7, c6fdec68fd8b4bd2ab0af592ef7d88a7; no voters:
I20260809 02:21:20.405699 13423 raft_consensus.cc:2781] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:20.405759 13423 raft_consensus.cc:482] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:20.405786 13423 raft_consensus.cc:3037] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:20.406884 13423 raft_consensus.cc:504] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.407217 13423 leader_election.cc:288] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [CANDIDATE]: Term 1 election: Requested vote from peers 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409), 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163)
I20260809 02:21:20.407557 13097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9377bf41d1c486f96652bfbede66cdc" candidate_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176183f09b3f483ab086609efc4b091d"
I20260809 02:21:20.407577 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9377bf41d1c486f96652bfbede66cdc" candidate_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6b2171f02b425896f65b8053c8e1a7"
I20260809 02:21:20.407675 13306 raft_consensus.cc:3037] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:20.407687 13097 raft_consensus.cc:3037] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:20.408677 13306 raft_consensus.cc:2454] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6fdec68fd8b4bd2ab0af592ef7d88a7 in term 1.
I20260809 02:21:20.408790 13097 raft_consensus.cc:2454] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6fdec68fd8b4bd2ab0af592ef7d88a7 in term 1.
I20260809 02:21:20.408984 12754 leader_election.cc:302] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a6b2171f02b425896f65b8053c8e1a7, c6fdec68fd8b4bd2ab0af592ef7d88a7; no voters:
I20260809 02:21:20.409142 13423 raft_consensus.cc:2781] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:20.409288 13423 raft_consensus.cc:686] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 LEADER]: Becoming Leader. State: Replica: c6fdec68fd8b4bd2ab0af592ef7d88a7, State: Running, Role: LEADER
I20260809 02:21:20.409418 13423 consensus_queue.cc:237] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } }
I20260809 02:21:20.410959 12621 catalog_manager.cc:5495] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193). New cstate: current_term: 1 leader_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fdec68fd8b4bd2ab0af592ef7d88a7" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 44731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 } health_report { overall_health: UNKNOWN } } }
I20260809 02:21:20.434280 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:20.431631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58446 (local address 127.1.81.193:44731)
0809 02:21:20.431912 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:20.431919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:20.431930 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:21:20.431967 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:20.431969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:20.432007 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:20.432075 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:20.432254 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.432754 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.433486 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.433692 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.433756 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:20.433924 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:20.433986 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:20.434030 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:20.434095 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:21:20.434135 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":111,"threads_started":1}
I20260809 02:21:20.442942 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:20.440167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:40383 (local address 127.1.81.195:34163)
0809 02:21:20.440280 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:20.440285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:20.440429 (+ 144us) server_negotiation.cc:407] Connection header received
0809 02:21:20.440553 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:20.440556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:20.440602 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:20.440663 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:20.440824 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.441286 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.442045 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.442254 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.442327 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:20.442600 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:20.442672 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:20.442728 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:20.442799 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 02:21:20.442846 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:21:20.442957 13565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:20.440109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:34163 (local address 127.1.81.193:40383)
0809 02:21:20.440363 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:20.440374 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:20.440454 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:20.440675 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:20.440676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:20.440682 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:21:20.440755 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:20.440760 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.441360 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.441362 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:20.441946 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:20.441954 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.442333 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.442335 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:20.442425 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:20.442474 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:21:20.442738 (+ 264us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:21:20.442743 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:21:20.442785 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 02:21:20.442855 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":91,"threads_started":1}
I20260809 02:21:20.447880 13306 raft_consensus.cc:1261] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Refusing update from remote peer c6fdec68fd8b4bd2ab0af592ef7d88a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:20.447932 13097 raft_consensus.cc:1261] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Refusing update from remote peer c6fdec68fd8b4bd2ab0af592ef7d88a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:20.448261 13423 consensus_queue.cc:1035] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a6b2171f02b425896f65b8053c8e1a7" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:20.448431 13554 consensus_queue.cc:1035] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "176183f09b3f483ab086609efc4b091d" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:20.463148 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:20.460313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:55991 (local address 127.1.81.193:44731)
0809 02:21:20.460417 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:20.460420 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:20.460436 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:21:20.460511 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:20.460513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:20.460549 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:20.460603 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:20.460938 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.461400 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.462175 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.462378 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.462478 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:20.462719 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:20.462793 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:20.462859 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:20.462970 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 02:21:20.463025 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:21:20.463165 13571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:20.460128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:44731 (local address 127.1.81.195:55991)
0809 02:21:20.460339 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:20.460353 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:20.460435 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:20.460627 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:20.460630 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:20.460638 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:21:20.460736 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:20.460742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.461496 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.461499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:20.462093 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:20.462101 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:20.462485 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:20.462489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:20.462573 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:20.462607 (+ 34us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:21:20.462878 (+ 271us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:21:20.462885 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 02:21:20.462943 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 02:21:20.463021 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":61,"threads_started":1}
I20260809 02:21:20.481920 12620 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:20.482056 12620 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:20.483934 12620 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36c334dd29bf422ca30343b919237465: Sending DeleteTablet for 3 replicas of tablet e9377bf41d1c486f96652bfbede66cdc
I20260809 02:21:20.484406 12837 tablet_service.cc:1514] Processing DeleteTablet for tablet e9377bf41d1c486f96652bfbede66cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:20 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:58436
I20260809 02:21:20.484434 13278 tablet_service.cc:1514] Processing DeleteTablet for tablet e9377bf41d1c486f96652bfbede66cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:20 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42474
I20260809 02:21:20.484447 13065 tablet_service.cc:1514] Processing DeleteTablet for tablet e9377bf41d1c486f96652bfbede66cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:20 UTC) from {username='oryx', principal='oryx/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:56776
I20260809 02:21:20.484575 13522 tablet_replica.cc:330] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7: stopping tablet replica
I20260809 02:21:20.484593 13521 tablet_replica.cc:330] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: stopping tablet replica
I20260809 02:21:20.484614 13519 tablet_replica.cc:330] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: stopping tablet replica
I20260809 02:21:20.484697 13521 raft_consensus.cc:2229] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:20.484695 13522 raft_consensus.cc:2229] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:20.484730 13519 raft_consensus.cc:2229] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:20.484776 13521 raft_consensus.cc:2258] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:20.484813 13519 raft_consensus.cc:2258] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:20.484854 13522 raft_consensus.cc:2258] T e9377bf41d1c486f96652bfbede66cdc P c6fdec68fd8b4bd2ab0af592ef7d88a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:20.485360 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 12726
I20260809 02:21:20.485744 13521 ts_tablet_manager.cc:1905] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:20.485744 13519 ts_tablet_manager.cc:1905] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:20.488807 13519 ts_tablet_manager.cc:1918] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:21:20.488873 13519 log.cc:1196] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/e9377bf41d1c486f96652bfbede66cdc
I20260809 02:21:20.489063 13519 ts_tablet_manager.cc:1939] T e9377bf41d1c486f96652bfbede66cdc P 3a6b2171f02b425896f65b8053c8e1a7: Deleting consensus metadata
I20260809 02:21:20.491247 12606 catalog_manager.cc:4841] TS 3a6b2171f02b425896f65b8053c8e1a7 (127.1.81.195:34163): tablet e9377bf41d1c486f96652bfbede66cdc (table test-table [id=53dc9b57a0564638b6e639a3c381d458]) successfully deleted
I20260809 02:21:20.491478 13521 ts_tablet_manager.cc:1918] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:21:20.491573 13521 log.cc:1196] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/e9377bf41d1c486f96652bfbede66cdc
I20260809 02:21:20.491832 13521 ts_tablet_manager.cc:1939] T e9377bf41d1c486f96652bfbede66cdc P 176183f09b3f483ab086609efc4b091d: Deleting consensus metadata
I20260809 02:21:20.492432 12599 catalog_manager.cc:4841] TS 176183f09b3f483ab086609efc4b091d (127.1.81.194:37409): tablet e9377bf41d1c486f96652bfbede66cdc (table test-table [id=53dc9b57a0564638b6e639a3c381d458]) successfully deleted
W20260809 02:21:20.499570 12606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:44731 (error 108)
I20260809 02:21:20.500293 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 12954
I20260809 02:21:20.500586 13575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:20.500209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:44731 (local address 127.0.0.1:58448)
0809 02:21:20.500421 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:20.500495 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:44731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":54,"threads_started":1}
W20260809 02:21:20.503346 12606 catalog_manager.cc:4584] TS c6fdec68fd8b4bd2ab0af592ef7d88a7 (127.1.81.193:44731): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e9377bf41d1c486f96652bfbede66cdc: Network error: Client connection negotiation failed: client connection to 127.1.81.193:44731: connect: Connection refused (error 111)
I20260809 02:21:20.511473 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 13176
I20260809 02:21:20.524071 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 12575
2026-08-09T02:21:20Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3713 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:20 dist-test-slave-jlzn krb5kdc[13580](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:20 dist-test-slave-jlzn krb5kdc[13580](info): set up 2 sockets
Aug 09 02:21:20 dist-test-slave-jlzn krb5kdc[13580](info): commencing operation
krb5kdc: starting...
W20260809 02:21:21.649413 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:21 dist-test-slave-jlzn krb5kdc[13580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:21:21.760478 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:42331
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:42331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:21.867818 13603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:21.868039 13603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:21.868075 13603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:21.872215 13603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:21.872264 13603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:21.872282 13603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:21.872296 13603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:21.872310 13603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:21.877255 13603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:42331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:42331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:21.878067 13603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:21.878921 13603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:21.886720 13614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:21.886848 13603 server_base.cc:1034] running on GCE node
W20260809 02:21:21.886888 13608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:21.887009 13609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:21.887517 13603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:21.888509 13603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:21.889674 13603 hybrid_clock.cc:648] HybridClock initialized: now 1786242081889648 us; error 36 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T02:21:21Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1375 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:21 dist-test-slave-jlzn krb5kdc[13623](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:21 dist-test-slave-jlzn krb5kdc[13623](info): set up 2 sockets
Aug 09 02:21:21 dist-test-slave-jlzn krb5kdc[13623](info): commencing operation
krb5kdc: starting...
W20260809 02:21:23.023653 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:23 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:21:23.135082 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41179
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:23.240463 13641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:23.240690 13641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:23.240743 13641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:23.244577 13641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:23.244625 13641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:23.244652 13641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:23.244670 13641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:23.244691 13641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:23.249763 13641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:41179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:23.250625 13641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:23.251498 13641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:23.259228 13648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:23.259275 13651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:23.259413 13641 server_base.cc:1034] running on GCE node
W20260809 02:21:23.259546 13646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:23.260097 13641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:23.261046 13641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:23.262205 13641 hybrid_clock.cc:648] HybridClock initialized: now 1786242083262187 us; error 32 us; skew 500 ppm
Aug 09 02:21:23 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:23.264840 13641 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:21:23.265604 13641 webserver.cc:460] Webserver started at http://127.1.81.254:41353/ using document root <none> and password file <none>
I20260809 02:21:23.266069 13641 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:23.266125 13641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:23.266278 13641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:23.268126 13641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "de6d851e86a641ed97dd2d756b3d1f0b"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "adcb5a9c79a10d112cda023a58aae688"
server_key_iv: "8da9d16f7b4ee6853f3b945e30351107"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.268602 13641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "de6d851e86a641ed97dd2d756b3d1f0b"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "adcb5a9c79a10d112cda023a58aae688"
server_key_iv: "8da9d16f7b4ee6853f3b945e30351107"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.271893 13641 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:23.274062 13660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.275131 13641 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:23.275228 13641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "de6d851e86a641ed97dd2d756b3d1f0b"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "adcb5a9c79a10d112cda023a58aae688"
server_key_iv: "8da9d16f7b4ee6853f3b945e30351107"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.275303 13641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:23.288261 13641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:23.290999 13641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:23.291131 13641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:23.297545 13641 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:41179
I20260809 02:21:23.297561 13741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:41179 every 8 connection(s)
I20260809 02:21:23.298399 13641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:23.299780 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 13641
I20260809 02:21:23.299926 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:23.300235 1351 external_mini_cluster.cc:1428] Setting key 87e170b6538b273b06f028107280cca2
I20260809 02:21:23.301359 13742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:23.307221 13742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Bootstrap starting.
Aug 09 02:21:23 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:23.309459 13742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:23.310107 13742 log.cc:824] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:23.311862 13742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: No bootstrap required, opened a new log
I20260809 02:21:23.313318 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:23.301478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39682 (local address 127.1.81.254:41179)
0809 02:21:23.301855 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:23.301870 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:23.301903 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:21:23.302474 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:23.302489 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:23.302781 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:23.303027 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:23.303916 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.304875 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.306000 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.306425 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.306527 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:23.309059 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:23.309064 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:23.309077 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:23.309103 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:23.310761 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:23.311156 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:23.311163 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:23.311168 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:23.311276 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:23.311530 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:23.311543 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:23.311545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:23.311969 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:23.312145 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:23.312421 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 02:21:23.312697 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":121,"threads_started":1}
I20260809 02:21:23.315464 13742 raft_consensus.cc:348] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } }
I20260809 02:21:23.315670 13742 raft_consensus.cc:374] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:23.315726 13742 raft_consensus.cc:729] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de6d851e86a641ed97dd2d756b3d1f0b, State: Initialized, Role: FOLLOWER
I20260809 02:21:23.316098 13742 consensus_queue.cc:260] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } }
I20260809 02:21:23.316220 13742 raft_consensus.cc:388] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:23.316282 13742 raft_consensus.cc:482] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:23.316376 13742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:23.317131 13742 raft_consensus.cc:504] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } }
I20260809 02:21:23.317423 13742 leader_election.cc:302] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de6d851e86a641ed97dd2d756b3d1f0b; no voters:
I20260809 02:21:23.317674 13742 leader_election.cc:288] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:23.317780 13749 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:23.317982 13749 raft_consensus.cc:686] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 1 LEADER]: Becoming Leader. State: Replica: de6d851e86a641ed97dd2d756b3d1f0b, State: Running, Role: LEADER
I20260809 02:21:23.318266 13749 consensus_queue.cc:237] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } }
I20260809 02:21:23.318717 13742 sys_catalog.cc:564] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:23.319873 13752 sys_catalog.cc:455] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader de6d851e86a641ed97dd2d756b3d1f0b. Latest consensus state: current_term: 1 leader_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } } }
I20260809 02:21:23.319866 13751 sys_catalog.cc:455] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } } }
I20260809 02:21:23.320016 13752 sys_catalog.cc:458] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:23.320016 13751 sys_catalog.cc:458] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:23.320411 13765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:23.323280 13765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:23.328486 13765 catalog_manager.cc:1347] Generated new cluster ID: 2e2c450af89340eba30526911a7876a9
I20260809 02:21:23.328547 13765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:23.356534 13765 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:23.357658 13765 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:23.361505 13765 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Generated new TSK 0
I20260809 02:21:23.362048 13765 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:21:23.395591 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:41179
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:23.533974 13784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:23.534194 13784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:23.534233 13784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:23.538050 13784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:23.538093 13784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:23.538147 13784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:23.543021 13784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:23.543851 13784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:23.544694 13784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:23.553580 13796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:23.553612 13793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:23.553611 13794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:23.553798 13784 server_base.cc:1034] running on GCE node
I20260809 02:21:23.554293 13784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:23.554875 13784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:23.556025 13784 hybrid_clock.cc:648] HybridClock initialized: now 1786242083556010 us; error 27 us; skew 500 ppm
Aug 09 02:21:23 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:23.558527 13784 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:21:23.559321 13784 webserver.cc:460] Webserver started at http://127.1.81.193:42157/ using document root <none> and password file <none>
I20260809 02:21:23.559839 13784 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:23.559914 13784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:23.560111 13784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:23.561952 13784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "1cb0e8db871f48c8a8e99eff95670f98"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "4de1dff6cc5a2924ee8aef2e0b6ef8c5"
server_key_iv: "270d080705f47c1024e0ac9c1ead8271"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.562462 13784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "1cb0e8db871f48c8a8e99eff95670f98"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "4de1dff6cc5a2924ee8aef2e0b6ef8c5"
server_key_iv: "270d080705f47c1024e0ac9c1ead8271"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.565887 13784 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:21:23.568053 13805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.569139 13784 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:21:23.569257 13784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "1cb0e8db871f48c8a8e99eff95670f98"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "4de1dff6cc5a2924ee8aef2e0b6ef8c5"
server_key_iv: "270d080705f47c1024e0ac9c1ead8271"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.569347 13784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:23.578696 13784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:23.581189 13784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:23.581349 13784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:23.581872 13784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:23.582597 13784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:23.582651 13784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.582702 13784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:23.582736 13784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.590754 13784 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:39279
I20260809 02:21:23.590780 13985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:39279 every 8 connection(s)
I20260809 02:21:23.591506 13784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:21:23 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:23.601634 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 13784
I20260809 02:21:23.601761 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:23.602034 1351 external_mini_cluster.cc:1428] Setting key 67cbf5dce670030ec4a0c5042144d2ef
I20260809 02:21:23.603345 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:23.593135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:56181 (local address 127.1.81.254:41179)
0809 02:21:23.593282 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:23.593287 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:23.594207 (+ 920us) server_negotiation.cc:407] Connection header received
0809 02:21:23.594986 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:23.594988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:23.595033 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:23.595100 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:23.596092 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.596611 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.597631 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.597852 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.597918 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:23.600019 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:23.600022 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:23.600024 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:23.600050 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:23.601318 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:23.601823 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:23.601827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:23.601829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:23.601918 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:23.602259 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:23.602263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:23.602264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:23.602470 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:23.602569 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:23.603059 (+ 490us) server_negotiation.cc:299] Negotiation successful
0809 02:21:23.603189 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:21:23.604171 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:23.593473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:56181)
0809 02:21:23.594073 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:23.594111 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:23.594827 (+ 716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:23.595219 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:23.595225 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:23.595529 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:23.595982 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:23.595995 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.596701 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.596703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:23.597542 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:23.597551 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.597955 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.597957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:23.598091 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:23.598520 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:23.598535 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:23.599862 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:23.601433 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:23.601439 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:23.601451 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:23.601703 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:23.602010 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:23.602012 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:23.602014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:23.602169 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:23.602590 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:23.602596 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:23.602845 (+ 249us) client_negotiation.cc:769] Sending connection context
0809 02:21:23.602996 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 02:21:23.603262 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":119,"threads_started":1}
I20260809 02:21:23.605229 13986 heartbeater.cc:347] Connected to a master server at 127.1.81.254:41179
I20260809 02:21:23.605437 13986 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:23.605866 13986 heartbeater.cc:511] Master 127.1.81.254:41179 requested a full tablet report, sending...
I20260809 02:21:23.607249 13686 ts_manager.cc:194] Registered new tserver with Master: 1cb0e8db871f48c8a8e99eff95670f98 (127.1.81.193:39279)
I20260809 02:21:23.608364 13686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:56181
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:21:23.628062 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:41179
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:23.734535 13993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:23.734761 13993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:23.734802 13993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:23.738638 13993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:23.738680 13993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:23.738734 13993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:23.743687 13993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:23.744593 13993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:23.745482 13993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:23.754606 14002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:23.754591 13999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:23.754640 13993 server_base.cc:1034] running on GCE node
W20260809 02:21:23.754583 14000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:23.755234 13993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:23.755790 13993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:23.756968 13993 hybrid_clock.cc:648] HybridClock initialized: now 1786242083756947 us; error 32 us; skew 500 ppm
Aug 09 02:21:23 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:23.759573 13993 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:21:23.760373 13993 webserver.cc:460] Webserver started at http://127.1.81.194:41269/ using document root <none> and password file <none>
I20260809 02:21:23.760841 13993 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:23.760896 13993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:23.761050 13993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:23.762868 13993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "63ff415dbbc949d481245c674fde4c8a"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "c42d22facc41ad93482b0c2b39536141"
server_key_iv: "49d19327b28cfbb882ad559448207059"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.763365 13993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "63ff415dbbc949d481245c674fde4c8a"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "c42d22facc41ad93482b0c2b39536141"
server_key_iv: "49d19327b28cfbb882ad559448207059"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.766669 13993 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:21:23.768883 14011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.769948 13993 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:23.770040 13993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "63ff415dbbc949d481245c674fde4c8a"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "c42d22facc41ad93482b0c2b39536141"
server_key_iv: "49d19327b28cfbb882ad559448207059"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.770116 13993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:23.780766 13993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:23.783520 13993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:23.783655 13993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:23.784179 13993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:23.784891 13993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:23.784937 13993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.784973 13993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:23.784992 13993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.793191 13993 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:43539
I20260809 02:21:23.793241 14187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:43539 every 8 connection(s)
I20260809 02:21:23.793939 13993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:21:23 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:23.803270 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 13993
I20260809 02:21:23.803396 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:23.803725 1351 external_mini_cluster.cc:1428] Setting key ee0708d0e66b87b96201260113794b6b
I20260809 02:21:23.806183 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:23.795513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:43635 (local address 127.1.81.254:41179)
0809 02:21:23.795632 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:23.795636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:23.796595 (+ 959us) server_negotiation.cc:407] Connection header received
0809 02:21:23.797435 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:23.797439 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:23.797498 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:23.797566 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:23.798622 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.799137 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.800305 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.800527 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.800758 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:23.802877 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:23.802880 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:23.802882 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:23.802907 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:23.804269 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:23.804780 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:23.804783 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:23.804784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:23.804865 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:23.805195 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:23.805198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:23.805199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:23.805375 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:23.805450 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:23.805968 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 02:21:23.806060 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:21:23.807080 14191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:23.795856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:43635)
0809 02:21:23.796462 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:23.796500 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:23.797243 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:23.797746 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:23.797753 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:23.798063 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:23.798477 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:23.798490 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.799268 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.799272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:23.800186 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:23.800197 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:23.800783 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:23.800787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:23.800967 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:23.801409 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:23.801424 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:23.802721 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:23.804377 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:23.804383 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:23.804395 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:23.804699 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:23.804956 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:23.804959 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:23.804961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:23.805091 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:23.805478 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:23.805484 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:23.805755 (+ 271us) client_negotiation.cc:769] Sending connection context
0809 02:21:23.805931 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 02:21:23.806236 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":113,"threads_started":1}
I20260809 02:21:23.808111 14188 heartbeater.cc:347] Connected to a master server at 127.1.81.254:41179
I20260809 02:21:23.808339 14188 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:23.808840 14188 heartbeater.cc:511] Master 127.1.81.254:41179 requested a full tablet report, sending...
I20260809 02:21:23.809782 13686 ts_manager.cc:194] Registered new tserver with Master: 63ff415dbbc949d481245c674fde4c8a (127.1.81.194:43539)
I20260809 02:21:23.810458 13686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:43635
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:21:23.830391 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:41179
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:23.938084 14196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:23.938298 14196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:23.938338 14196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:23.942183 14196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:23.942230 14196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:23.942298 14196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:23.947237 14196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:23.948114 14196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:23.948997 14196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:23.958277 14203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:23.958262 14204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:23.958312 14196 server_base.cc:1034] running on GCE node
W20260809 02:21:23.958249 14206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:23.958781 14196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:23.959347 14196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:23.960496 14196 hybrid_clock.cc:648] HybridClock initialized: now 1786242083960481 us; error 25 us; skew 500 ppm
Aug 09 02:21:23 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:23.962997 14196 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:21:23.963742 14196 webserver.cc:460] Webserver started at http://127.1.81.195:36437/ using document root <none> and password file <none>
I20260809 02:21:23.964257 14196 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:23.964315 14196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:23.964478 14196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:23.966360 14196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "e7a53ac9a4534b3289de6759b4a19352"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "13dda6b6cf88bf04b3ee62a6320b8dba"
server_key_iv: "98cfd0dd39c172812020cab92c36be6c"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.966838 14196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "e7a53ac9a4534b3289de6759b4a19352"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "13dda6b6cf88bf04b3ee62a6320b8dba"
server_key_iv: "98cfd0dd39c172812020cab92c36be6c"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.970170 14196 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:21:23.972323 14213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.973457 14196 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:23.973574 14196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "e7a53ac9a4534b3289de6759b4a19352"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "13dda6b6cf88bf04b3ee62a6320b8dba"
server_key_iv: "98cfd0dd39c172812020cab92c36be6c"
server_key_version: "encryptionkey@0"
I20260809 02:21:23.973677 14196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:23.992861 14196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:23.995234 14196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:23.995368 14196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:23.995903 14196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:23.996632 14196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:23.996677 14196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:23.996713 14196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:23.996732 14196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.004940 14196 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:46801
I20260809 02:21:24.004971 14385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:46801 every 8 connection(s)
I20260809 02:21:24.005729 14196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242083, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:24.015977 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 14196
I20260809 02:21:24.016120 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:24.016402 1351 external_mini_cluster.cc:1428] Setting key 39f78c9ce5a2952e99c4488c1821a790
I20260809 02:21:24.017877 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.007321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:58639 (local address 127.1.81.254:41179)
0809 02:21:24.007445 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.007449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.008373 (+ 924us) server_negotiation.cc:407] Connection header received
0809 02:21:24.009162 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.009164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.009210 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.009278 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.010280 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.010780 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.012206 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.012431 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.012509 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.014680 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:24.014683 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:24.014685 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:24.014711 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:24.015926 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:24.016418 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:24.016422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:24.016424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:24.016525 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:24.016855 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:24.016859 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:24.016860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:24.017051 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:24.017143 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:24.017591 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 02:21:24.017718 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:21:24.018579 14391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.007631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:58639)
0809 02:21:24.008258 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.008295 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.008998 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.009417 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.009424 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.009749 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.010173 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.010185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.010866 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.010868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.012085 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.012096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.012552 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.012554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.012696 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.013189 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.013204 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.014533 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:24.016032 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:24.016038 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:24.016051 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:24.016324 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:24.016613 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:24.016616 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:24.016617 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:24.016756 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:24.017158 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:24.017164 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:24.017372 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 02:21:24.017526 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 02:21:24.017829 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":132,"threads_started":1}
I20260809 02:21:24.019562 14387 heartbeater.cc:347] Connected to a master server at 127.1.81.254:41179
I20260809 02:21:24.019774 14387 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:24.020282 14387 heartbeater.cc:511] Master 127.1.81.254:41179 requested a full tablet report, sending...
I20260809 02:21:24.021216 13686 ts_manager.cc:194] Registered new tserver with Master: e7a53ac9a4534b3289de6759b4a19352 (127.1.81.195:46801)
I20260809 02:21:24.021747 13686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:58639
I20260809 02:21:24.029702 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab.
Entry for principal oryx/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab.
WARNING: no policy specified for oryx/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab.
Entry for principal oryx/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab.
WARNING: no policy specified for oryx/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab.
Entry for principal oryx/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab.
I20260809 02:21:24.091670 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 13784
I20260809 02:21:24.106644 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 13993
I20260809 02:21:24.115152 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 14196
I20260809 02:21:24.131986 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 13641
I20260809 02:21:24.144227 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41179
--webserver_interface=127.1.81.254
--webserver_port=41353
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:24.251070 14399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:24.251297 14399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:24.251333 14399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:24.255175 14399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:24.255223 14399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:24.255240 14399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:24.255257 14399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:24.255273 14399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:24.260232 14399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:41179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=41353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:24.261082 14399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:24.261932 14399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:24.269704 14413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:24.269698 14408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:24.269696 14410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:24.269747 14399 server_base.cc:1034] running on GCE node
I20260809 02:21:24.270457 14399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:24.271416 14399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:24.272567 14399 hybrid_clock.cc:648] HybridClock initialized: now 1786242084272555 us; error 24 us; skew 500 ppm
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242084, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:24.275074 14399 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:21:24.275877 14399 webserver.cc:460] Webserver started at http://127.1.81.254:41353/ using document root <none> and password file <none>
I20260809 02:21:24.276352 14399 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:24.276417 14399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:24.279879 14399 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 02:21:24.281790 14424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.282892 14399 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:24.283002 14399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "de6d851e86a641ed97dd2d756b3d1f0b"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "adcb5a9c79a10d112cda023a58aae688"
server_key_iv: "8da9d16f7b4ee6853f3b945e30351107"
server_key_version: "encryptionkey@0"
I20260809 02:21:24.283483 14399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:24.294965 14399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:24.297346 14399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:24.297508 14399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:24.304015 14399 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:41179
I20260809 02:21:24.304092 14507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:41179 every 8 connection(s)
I20260809 02:21:24.304975 14399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:24.308885 14508 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:21:24.309404 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 14399
I20260809 02:21:24.309804 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:39279
--local_ip_for_outbound_sockets=127.1.81.193
--tserver_master_addrs=127.1.81.254:41179
--webserver_port=42157
--webserver_interface=127.1.81.193
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.81.193
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:24.310534 14508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Bootstrap starting.
I20260809 02:21:24.331462 14508 log.cc:824] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:24.337654 14508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:21:24.337960 14508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Bootstrap complete.
I20260809 02:21:24.341928 14508 raft_consensus.cc:348] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } }
I20260809 02:21:24.342329 14508 raft_consensus.cc:729] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de6d851e86a641ed97dd2d756b3d1f0b, State: Initialized, Role: FOLLOWER
I20260809 02:21:24.342799 14508 consensus_queue.cc:260] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } }
I20260809 02:21:24.342924 14508 raft_consensus.cc:388] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:24.342990 14508 raft_consensus.cc:482] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:24.343089 14508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:21:24.344940 14508 raft_consensus.cc:504] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } }
I20260809 02:21:24.345268 14508 leader_election.cc:302] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de6d851e86a641ed97dd2d756b3d1f0b; no voters:
I20260809 02:21:24.345558 14508 leader_election.cc:288] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:21:24.345664 14515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:21:24.345896 14515 raft_consensus.cc:686] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [term 2 LEADER]: Becoming Leader. State: Replica: de6d851e86a641ed97dd2d756b3d1f0b, State: Running, Role: LEADER
I20260809 02:21:24.346189 14515 consensus_queue.cc:237] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } }
I20260809 02:21:24.346613 14508 sys_catalog.cc:564] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:24.347107 14515 sys_catalog.cc:455] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader de6d851e86a641ed97dd2d756b3d1f0b. Latest consensus state: current_term: 2 leader_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } } }
I20260809 02:21:24.347223 14515 sys_catalog.cc:458] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:24.348253 14516 sys_catalog.cc:455] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6d851e86a641ed97dd2d756b3d1f0b" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41179 } } }
I20260809 02:21:24.348351 14516 sys_catalog.cc:458] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:24.348588 14524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:24.352083 14524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:24.352703 14524 catalog_manager.cc:1259] Loaded cluster ID: 2e2c450af89340eba30526911a7876a9
I20260809 02:21:24.352766 14524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:24.355034 14524 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:24.355682 14524 catalog_manager.cc:5879] T 00000000000000000000000000000000 P de6d851e86a641ed97dd2d756b3d1f0b: Loaded TSK: 0
I20260809 02:21:24.356837 14524 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:21:24.426909 14510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:24.427135 14510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:24.427181 14510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:24.431104 14510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:24.431157 14510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:24.431210 14510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:24.436205 14510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.193.keytab
--principal=oryx/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:39279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=42157
--tserver_master_addrs=127.1.81.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:24.437088 14510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:24.437994 14510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:24.446903 14549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:24.447005 14550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:24.447290 14554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:24.447351 14510 server_base.cc:1034] running on GCE node
I20260809 02:21:24.447695 14510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:24.448312 14510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:24.449473 14510 hybrid_clock.cc:648] HybridClock initialized: now 1786242084449440 us; error 50 us; skew 500 ppm
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242084, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:24.452061 14510 init.cc:377] Logged in from keytab as oryx/127.1.81.193@KRBTEST.COM (short username oryx)
I20260809 02:21:24.452859 14510 webserver.cc:460] Webserver started at http://127.1.81.193:42157/ using document root <none> and password file <none>
I20260809 02:21:24.453342 14510 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:24.453413 14510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:24.457015 14510 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:24.459004 14563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.460238 14510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:24.460346 14510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "1cb0e8db871f48c8a8e99eff95670f98"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "4de1dff6cc5a2924ee8aef2e0b6ef8c5"
server_key_iv: "270d080705f47c1024e0ac9c1ead8271"
server_key_version: "encryptionkey@0"
I20260809 02:21:24.460825 14510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:24.474331 14510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:24.477134 14510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:24.477291 14510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:24.477803 14510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:24.478567 14510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:24.478616 14510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.478674 14510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:24.478699 14510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.487049 14510 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:39279
I20260809 02:21:24.487110 14754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:39279 every 8 connection(s)
I20260809 02:21:24.487982 14510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:24.497366 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 14510
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:24.497805 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:43539
--local_ip_for_outbound_sockets=127.1.81.194
--tserver_master_addrs=127.1.81.254:41179
--webserver_port=41269
--webserver_interface=127.1.81.194
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.81.194
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:24.499516 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.489748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:44819 (local address 127.1.81.254:41179)
0809 02:21:24.490133 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.490156 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.490659 (+ 503us) server_negotiation.cc:407] Connection header received
0809 02:21:24.491628 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.491639 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.491931 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.492193 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.493119 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.494024 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.495081 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.495508 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.495623 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.498901 (+ 3278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:44819: BlockingRecv error: recv got EOF from 127.1.81.193:44819 (error 108)
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":88,"threads_started":1}
I20260809 02:21:24.499559 14760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.489870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:44819)
0809 02:21:24.490509 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.490557 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.491313 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.492259 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.492265 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.492569 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.492990 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.493002 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.494123 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.494125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.494987 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.494997 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.495617 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.495620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.495754 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.496260 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.496276 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.498714 (+ 2438us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":106,"threads_started":1}
W20260809 02:21:24.500267 14755 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:41179 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.81.254:41179: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:24.505069 14760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.500661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:58571)
0809 02:21:24.500807 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.500820 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.500903 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.501101 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.501104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.501265 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.501349 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.501355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.502051 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.502054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.502578 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.502586 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.502992 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.502995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.503080 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.503471 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.503482 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.504959 (+ 1477us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":91}
W20260809 02:21:24.505187 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.500728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:58571 (local address 127.1.81.254:41179)
0809 02:21:24.500827 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.500830 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.500861 (+ 31us) server_negotiation.cc:407] Connection header received
0809 02:21:24.500970 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.500972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.501006 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.501069 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.501470 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.501953 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.502689 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.502898 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.502979 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.505089 (+ 2110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:58571: BlockingRecv error: recv got EOF from 127.1.81.193:58571 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:24.509871 14760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.505731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:52017)
0809 02:21:24.505829 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.505841 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.505909 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.506095 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.506097 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.506230 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.506290 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.506295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.506938 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.506941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.507428 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.507435 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.507840 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.507844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.507917 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.508280 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.508291 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.509762 (+ 1471us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 02:21:24.510042 14755 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:21:24.510052 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.505826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:52017 (local address 127.1.81.254:41179)
0809 02:21:24.505928 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.505932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.505944 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:24.505975 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.505978 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.506011 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.506070 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.506390 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.506843 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.507526 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.507727 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.507833 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.509867 (+ 2034us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:52017: BlockingRecv error: recv got EOF from 127.1.81.193:52017 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 02:21:24.607614 14762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:24.607869 14762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:24.607924 14762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:24.611768 14762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:24.611831 14762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:24.611915 14762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:24.616875 14762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.194.keytab
--principal=oryx/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:43539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=41269
--tserver_master_addrs=127.1.81.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:24.617724 14762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:24.618584 14762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:24.627388 14778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:24.627434 14762 server_base.cc:1034] running on GCE node
W20260809 02:21:24.627391 14770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:24.627385 14771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:24.628051 14762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:24.628582 14762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:24.629733 14762 hybrid_clock.cc:648] HybridClock initialized: now 1786242084629714 us; error 35 us; skew 500 ppm
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242084, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:24.632485 14762 init.cc:377] Logged in from keytab as oryx/127.1.81.194@KRBTEST.COM (short username oryx)
I20260809 02:21:24.633284 14762 webserver.cc:460] Webserver started at http://127.1.81.194:41269/ using document root <none> and password file <none>
I20260809 02:21:24.633771 14762 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:24.633850 14762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:24.637293 14762 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260809 02:21:24.639079 14793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.640163 14762 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:21:24.640268 14762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "63ff415dbbc949d481245c674fde4c8a"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "c42d22facc41ad93482b0c2b39536141"
server_key_iv: "49d19327b28cfbb882ad559448207059"
server_key_version: "encryptionkey@0"
I20260809 02:21:24.640731 14762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:24.669847 14762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:24.672382 14762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:24.672544 14762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:24.673132 14762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:24.673921 14762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:24.673971 14762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.674023 14762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:24.674052 14762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.682554 14762 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:43539
I20260809 02:21:24.682581 14970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:43539 every 8 connection(s)
I20260809 02:21:24.683461 14762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:24.685160 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 14762
I20260809 02:21:24.685568 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:46801
--local_ip_for_outbound_sockets=127.1.81.195
--tserver_master_addrs=127.1.81.254:41179
--webserver_port=36437
--webserver_interface=127.1.81.195
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.81.195
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:21:24.694926 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.685164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:45407 (local address 127.1.81.254:41179)
0809 02:21:24.685313 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.685318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.686103 (+ 785us) server_negotiation.cc:407] Connection header received
0809 02:21:24.687563 (+ 1460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.687565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.687615 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.687709 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.689136 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.689886 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.691055 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.691402 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.691515 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.694795 (+ 3280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:45407: BlockingRecv error: recv got EOF from 127.1.81.194:45407 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:21:24.695258 14975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.685503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:45407)
0809 02:21:24.685944 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.685994 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.687325 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.687921 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.687930 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.688376 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.688981 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.688998 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.689990 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.689992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.690916 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.690926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.691541 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.691544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.691682 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.692236 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.692251 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.694525 (+ 2274us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":104,"threads_started":1}
W20260809 02:21:24.695770 14971 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:41179 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.81.254:41179: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:24.700973 14975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.696187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:57245)
0809 02:21:24.696334 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.696347 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.696409 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.696609 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.696611 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.696728 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.696808 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.696812 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.697727 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.697729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.698259 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.698265 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.698769 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.698772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.698832 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.699239 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.699249 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.700891 (+ 1642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":91}
W20260809 02:21:24.701136 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.696292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:57245 (local address 127.1.81.254:41179)
0809 02:21:24.696415 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.696419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.696435 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:21:24.696473 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.696476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.696519 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.696602 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.696903 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.697627 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.698347 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.698684 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.698775 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.701027 (+ 2252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:57245: BlockingRecv error: recv got EOF from 127.1.81.194:57245 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:24.706333 14978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.701395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:35927)
0809 02:21:24.701645 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.701666 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.701750 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.701935 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.701937 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.702082 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.702165 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.702170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.703070 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.703072 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.703616 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.703623 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.704164 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.704167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.704244 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.704661 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.704671 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.706225 (+ 1554us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":80,"threads_started":1}
W20260809 02:21:24.706456 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.701457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:35927 (local address 127.1.81.254:41179)
0809 02:21:24.701551 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.701555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.701732 (+ 177us) server_negotiation.cc:407] Connection header received
0809 02:21:24.701807 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.701809 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.701846 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.701914 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.702247 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.702989 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.703723 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.704056 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.704155 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.706359 (+ 2204us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:35927: BlockingRecv error: recv got EOF from 127.1.81.194:35927 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 02:21:24.706650 14971 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:21:24.797250 14977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:24.797477 14977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:24.797523 14977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:24.801477 14977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:24.801527 14977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:24.801604 14977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:24.806672 14977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/krb5kdc/oryx_127.1.81.195.keytab
--principal=oryx/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:46801
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=36437
--tserver_master_addrs=127.1.81.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:24.807596 14977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:24.808576 14977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:24.817898 14994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:24.817940 14987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:24.817914 14986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:24.818109 14977 server_base.cc:1034] running on GCE node
I20260809 02:21:24.818552 14977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:24.819144 14977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:24.820298 14977 hybrid_clock.cc:648] HybridClock initialized: now 1786242084820279 us; error 31 us; skew 500 ppm
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242084, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:24.822989 14977 init.cc:377] Logged in from keytab as oryx/127.1.81.195@KRBTEST.COM (short username oryx)
I20260809 02:21:24.823853 14977 webserver.cc:460] Webserver started at http://127.1.81.195:36437/ using document root <none> and password file <none>
I20260809 02:21:24.824363 14977 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:24.824437 14977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:24.828006 14977 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 02:21:24.829886 15007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.830986 14977 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:24.831099 14977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "e7a53ac9a4534b3289de6759b4a19352"
format_stamp: "Formatted at 2026-08-09 02:21:23 on dist-test-slave-jlzn"
server_key: "13dda6b6cf88bf04b3ee62a6320b8dba"
server_key_iv: "98cfd0dd39c172812020cab92c36be6c"
server_key_version: "encryptionkey@0"
I20260809 02:21:24.831601 14977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:24.861114 14977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:24.864187 14977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:24.864359 14977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:24.865006 14977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:24.865948 14977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:24.866003 14977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.866053 14977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:24.866093 14977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:24.875713 14977 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:46801
I20260809 02:21:24.875741 15185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:46801 every 8 connection(s)
I20260809 02:21:24.876690 14977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:24.882843 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 14977
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:21:24.887290 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.878332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:59081 (local address 127.1.81.254:41179)
0809 02:21:24.878451 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.878455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.879430 (+ 975us) server_negotiation.cc:407] Connection header received
0809 02:21:24.880317 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.880321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.880378 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.880450 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.881545 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.882056 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.883416 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.883752 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.883894 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.887172 (+ 3278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:59081: BlockingRecv error: recv got EOF from 127.1.81.195:59081 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:21:24.887858 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.878673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:59081)
0809 02:21:24.879294 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.879334 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.880126 (+ 792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.880619 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.880625 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.880954 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.881402 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.881416 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.882177 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.882180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.883276 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.883286 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.883930 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.883936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.884102 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.884612 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.884634 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.887061 (+ 2427us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":120,"threads_started":1}
W20260809 02:21:24.888336 15188 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:41179 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.81.254:41179: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
I20260809 02:21:24.892184 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.883772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39690 (local address 127.1.81.254:41179)
0809 02:21:24.884029 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.884032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.884041 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:21:24.884070 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.884072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.884102 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.884180 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.885053 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.885739 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.886649 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.886906 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.886990 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.888597 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:24.888604 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:24.888620 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:24.888662 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:24.890196 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:24.890622 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:24.890626 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:24.890629 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:24.890751 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:24.891013 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:24.891016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:24.891018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:24.891331 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:24.891520 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:24.891793 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 02:21:24.892026 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":108,"threads_started":1}
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:24.893415 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.888747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:34955)
0809 02:21:24.888844 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.888857 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.888928 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.889123 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.889125 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.889268 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.889354 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.889360 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.890018 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.890021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.890721 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.890731 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.891123 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.891127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.891222 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.891616 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.891630 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.893308 (+ 1678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 02:21:24.893517 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.888820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:34955 (local address 127.1.81.254:41179)
0809 02:21:24.888923 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.888927 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.888939 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:24.888998 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.889001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.889035 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.889097 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.889460 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.889922 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.890823 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.891032 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.891112 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.893430 (+ 2318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:34955: BlockingRecv error: recv got EOF from 127.1.81.195:34955 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:24 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:24.898186 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:24.894184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:46761)
0809 02:21:24.894322 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:24.894332 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:24.894387 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:24.894581 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:24.894583 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:24.894733 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:24.894802 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.894807 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.895406 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.895408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.895939 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:24.895946 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.896292 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.896294 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:24.896343 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.896659 (+ 316us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:24.896669 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:24.898070 (+ 1401us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":82}
W20260809 02:21:24.898272 14759 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:24.894257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:46761 (local address 127.1.81.254:41179)
0809 02:21:24.894376 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:24.894379 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:24.894392 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:24.894442 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:24.894445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:24.894482 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:24.894550 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:24.894890 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.895329 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.896018 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:24.896212 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:24.896280 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:24.898186 (+ 1906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:46761: BlockingRecv error: recv got EOF from 127.1.81.195:46761 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 02:21:24.898371 15188 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 02:21:25 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:25 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:25.515362 15195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:25.510566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:38357)
0809 02:21:25.510820 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:25.510834 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:25.510919 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:25.511134 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:25.511136 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:25.511314 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:25.511411 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:25.511416 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.512127 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.512129 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:25.512713 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:25.512720 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.513072 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.513074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:25.513130 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:25.513586 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:25.513597 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:25.515236 (+ 1639us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":68,"threads_started":1}
W20260809 02:21:25.515484 15196 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:25.510632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:38357 (local address 127.1.81.254:41179)
0809 02:21:25.510885 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:25.510889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:25.510902 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:25.510994 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:25.510996 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:25.511040 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:25.511113 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:25.511493 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.512051 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.512794 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.513001 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.513063 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:25.515366 (+ 2303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:38357: BlockingRecv error: recv got EOF from 127.1.81.193:38357 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
Aug 09 02:21:25 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:25 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:25.712023 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:25.707195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:55427)
0809 02:21:25.707442 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:25.707456 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:25.707548 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:25.707747 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:25.707750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:25.707940 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:25.708039 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:25.708045 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.708709 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.708711 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:25.709273 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:25.709279 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.709624 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.709626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:25.709702 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:25.710135 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:25.710146 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:25.711894 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":68,"threads_started":1}
W20260809 02:21:25.712117 15196 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:25.707248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:55427 (local address 127.1.81.254:41179)
0809 02:21:25.707378 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:25.707382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:25.707516 (+ 134us) server_negotiation.cc:407] Connection header received
0809 02:21:25.707614 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:25.707617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:25.707657 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:25.707722 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:25.708120 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.708633 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.709349 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.709549 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.709614 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:25.712009 (+ 2395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:55427: BlockingRecv error: recv got EOF from 127.1.81.194:55427 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 02:21:25 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:25 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:25.903761 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:25.898876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:49799)
0809 02:21:25.899129 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:25.899141 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:25.899232 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:25.899439 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:25.899441 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:25.899609 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:25.899740 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:25.899746 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.900456 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.900459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:25.901031 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:25.901038 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.901388 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.901391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:25.901456 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:25.901916 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:25.901928 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:25.903647 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":94,"threads_started":1}
W20260809 02:21:25.903923 15196 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:25.898945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:49799 (local address 127.1.81.254:41179)
0809 02:21:25.899061 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:25.899065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:25.899197 (+ 132us) server_negotiation.cc:407] Connection header received
0809 02:21:25.899311 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:25.899314 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:25.899358 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:25.899412 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:25.899842 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.900376 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.901107 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:25.901317 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:25.901382 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:25.903780 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:49799: BlockingRecv error: recv got EOF from 127.1.81.195:49799 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:21:26 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:26 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:26.521008 15200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:26.516085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:57749)
0809 02:21:26.516361 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:26.516374 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:26.516457 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:26.516674 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:26.516676 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:26.516848 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:26.516944 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:26.516949 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.517614 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.517616 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:26.518162 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:26.518169 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.518517 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.518519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:26.518575 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:26.519016 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:26.519027 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:26.520851 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":94,"threads_started":1}
W20260809 02:21:26.521126 15202 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:26.516161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:57749 (local address 127.1.81.254:41179)
0809 02:21:26.516415 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:26.516419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:26.516431 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:26.516532 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:26.516535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:26.516575 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:26.516654 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:26.517026 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.517539 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.518238 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.518444 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.518508 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:26.520996 (+ 2488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:57749: BlockingRecv error: recv got EOF from 127.1.81.193:57749 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":88,"threads_started":1}
Aug 09 02:21:26 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:26 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:26.717607 15203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:26.712700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:35671)
0809 02:21:26.712969 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:26.712983 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:26.713082 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:26.713292 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:26.713294 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:26.713470 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:26.713570 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:26.713575 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.714250 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.714252 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:26.714826 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:26.714833 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.715176 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.715178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:26.715235 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:26.715675 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:26.715686 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:26.717437 (+ 1751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":77,"threads_started":1}
W20260809 02:21:26.717674 15202 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:26.712753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:35671 (local address 127.1.81.254:41179)
0809 02:21:26.712904 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:26.712909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:26.713046 (+ 137us) server_negotiation.cc:407] Connection header received
0809 02:21:26.713158 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:26.713160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:26.713202 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:26.713265 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:26.713653 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.714170 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.714902 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.715102 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.715173 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:26.717576 (+ 2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:35671: BlockingRecv error: recv got EOF from 127.1.81.194:35671 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 02:21:26 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:26 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:26.912462 15204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:26.904444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:60305)
0809 02:21:26.904746 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:26.904759 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:26.904858 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:26.905062 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:26.905064 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:26.905238 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:26.905332 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:26.905337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.906163 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.906167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:26.906784 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:26.906796 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.907189 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.907192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:26.907250 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:26.910598 (+ 3348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:26.910610 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:26.912344 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":102,"threads_started":1}
W20260809 02:21:26.912595 15202 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:26.904551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:60305 (local address 127.1.81.254:41179)
0809 02:21:26.904688 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:26.904692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:26.904822 (+ 130us) server_negotiation.cc:407] Connection header received
0809 02:21:26.904931 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:26.904933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:26.904981 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:26.905036 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:26.905427 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.906026 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.906886 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:26.907101 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:26.907184 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:26.912471 (+ 5287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:60305: BlockingRecv error: recv got EOF from 127.1.81.195:60305 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 02:21:27 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:27 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:27.526801 15205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:27.521798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:55523)
0809 02:21:27.522079 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:27.522092 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:27.522191 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:27.522403 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:27.522405 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:27.522582 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:27.522681 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:27.522686 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.523351 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.523353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:27.523956 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:27.523966 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.524332 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.524334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:27.524390 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:27.524834 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:27.524845 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:27.526683 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":72,"threads_started":1}
W20260809 02:21:27.526924 15206 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:27.521862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:55523 (local address 127.1.81.254:41179)
0809 02:21:27.522132 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:27.522135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:27.522148 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:27.522263 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:27.522265 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:27.522307 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:27.522379 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:27.522759 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.523278 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.524042 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.524256 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.524323 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:27.526807 (+ 2484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:55523: BlockingRecv error: recv got EOF from 127.1.81.193:55523 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":107,"threads_started":1}
Aug 09 02:21:27 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:27 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:27.723063 15208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:27.718240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:51031)
0809 02:21:27.718490 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:27.718504 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:27.718599 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:27.718802 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:27.718804 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:27.718983 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:27.719079 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:27.719084 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.719753 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.719755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:27.720363 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:27.720374 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.720730 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.720733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:27.720794 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:27.721239 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:27.721249 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:27.722948 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":73,"threads_started":1}
W20260809 02:21:27.723203 15206 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:27.718302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:51031 (local address 127.1.81.254:41179)
0809 02:21:27.718454 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:27.718459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:27.718554 (+ 95us) server_negotiation.cc:407] Connection header received
0809 02:21:27.718677 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:27.718679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:27.718722 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:27.718776 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:27.719168 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.719676 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.720450 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.720656 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.720721 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:27.723082 (+ 2361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:51031: BlockingRecv error: recv got EOF from 127.1.81.194:51031 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 02:21:27 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:27 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:27.920879 15211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:27.913156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:45997)
0809 02:21:27.913432 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:27.913444 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:27.913549 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:27.913807 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:27.913810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:27.914006 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:27.914103 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:27.914108 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.914860 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.914864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:27.915447 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:27.915456 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.915914 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.915918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:27.916003 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:27.918921 (+ 2918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:27.918934 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:27.920713 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":86,"threads_started":1}
W20260809 02:21:27.920953 15206 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:27.913241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:45997 (local address 127.1.81.254:41179)
0809 02:21:27.913374 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:27.913379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:27.913508 (+ 129us) server_negotiation.cc:407] Connection header received
0809 02:21:27.913635 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:27.913638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:27.913704 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:27.913769 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:27.914226 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.914758 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.915561 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:27.915794 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:27.915909 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:27.920851 (+ 4942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:45997: BlockingRecv error: recv got EOF from 127.1.81.195:45997 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 02:21:28 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:28 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:28.532577 15213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:28.527538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:47219)
0809 02:21:28.527827 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:28.527840 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:28.527933 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:28.528158 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:28.528160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:28.528338 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:28.528453 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:28.528459 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.529155 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.529157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:28.529736 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:28.529745 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.530122 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.530125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:28.530198 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:28.530681 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:28.530693 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:28.532446 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
W20260809 02:21:28.532698 15214 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:28.527585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:47219 (local address 127.1.81.254:41179)
0809 02:21:28.527850 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:28.527854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:28.527889 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:21:28.528006 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:28.528008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:28.528052 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:28.528127 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:28.528536 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.529056 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.529820 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.530030 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.530096 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:28.532583 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:47219: BlockingRecv error: recv got EOF from 127.1.81.193:47219 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":76,"threads_started":1}
Aug 09 02:21:28 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:28 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:28.729274 15216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:28.723774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:44239)
0809 02:21:28.724179 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:28.724194 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:28.724309 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:28.724551 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:28.724555 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:28.724766 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:28.724863 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:28.724870 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.725612 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.725617 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:28.726221 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:28.726229 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.726667 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.726671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:28.726760 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:28.727196 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:28.727207 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:28.729143 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":86,"threads_started":1}
W20260809 02:21:28.729403 15214 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:28.723851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:44239 (local address 127.1.81.254:41179)
0809 02:21:28.724043 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:28.724048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:28.724285 (+ 237us) server_negotiation.cc:407] Connection header received
0809 02:21:28.724390 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:28.724393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:28.724445 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:28.724510 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:28.724973 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.725510 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.726329 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.726556 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.726641 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:28.729283 (+ 2642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:44239: BlockingRecv error: recv got EOF from 127.1.81.194:44239 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 09 02:21:28 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:28 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:28.926981 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:28.921699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:39247)
0809 02:21:28.921965 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:28.921977 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:28.922085 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:28.922333 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:28.922336 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:28.922538 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:28.922650 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:28.922657 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.923395 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.923399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:28.924032 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:28.924042 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.924471 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.924475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:28.924560 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:28.925075 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:28.925088 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:28.926863 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":86,"threads_started":1}
W20260809 02:21:28.927089 15214 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:28.921774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:39247 (local address 127.1.81.254:41179)
0809 02:21:28.921905 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:28.921910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:28.922040 (+ 130us) server_negotiation.cc:407] Connection header received
0809 02:21:28.922181 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:28.922184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:28.922232 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:28.922295 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:28.922764 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.923290 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.924148 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:28.924368 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:28.924454 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:28.926989 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:39247: BlockingRecv error: recv got EOF from 127.1.81.195:39247 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 02:21:29 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:29 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:29.538583 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:29.533280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:53071)
0809 02:21:29.533557 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:29.533570 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:29.533655 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:29.533866 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:29.533867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:29.534062 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:29.534165 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:29.534171 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.534881 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.534884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:29.535500 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:29.535510 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.535964 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.535967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:29.536032 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:29.536469 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:29.536479 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:29.538431 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":90,"threads_started":1}
W20260809 02:21:29.538733 15222 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:29.533338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:53071 (local address 127.1.81.254:41179)
0809 02:21:29.533607 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:29.533612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:29.533624 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:29.533727 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:29.533730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:29.533771 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:29.533843 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:29.534252 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.534789 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.535604 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.535854 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.535930 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:29.538582 (+ 2652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:53071: BlockingRecv error: recv got EOF from 127.1.81.193:53071 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":94,"threads_started":1}
Aug 09 02:21:29 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:29 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:29.735003 15223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:29.729996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:42445)
0809 02:21:29.730285 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:29.730297 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:29.730391 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:29.730577 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:29.730579 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:29.730768 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:29.730866 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:29.730872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.731605 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.731608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:29.732220 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:29.732231 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.732590 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.732593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:29.732651 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:29.733081 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:29.733092 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:29.734848 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":102,"threads_started":1}
W20260809 02:21:29.735087 15222 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:29.730111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:42445 (local address 127.1.81.254:41179)
0809 02:21:29.730251 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:29.730254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:29.730356 (+ 102us) server_negotiation.cc:407] Connection header received
0809 02:21:29.730458 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:29.730460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:29.730501 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:29.730563 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:29.730948 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.731506 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.732306 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.732514 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.732581 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:29.734988 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:42445: BlockingRecv error: recv got EOF from 127.1.81.194:42445 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 02:21:29 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:29 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:29.933092 15226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:29.927740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:50175)
0809 02:21:29.928025 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:29.928039 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:29.928149 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:29.928388 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:29.928391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:29.928626 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:29.928728 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:29.928734 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.929517 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.929520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:29.930123 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:29.930133 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.930580 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.930584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:29.930672 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:29.931108 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:29.931119 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:29.932941 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":104,"threads_started":1}
W20260809 02:21:29.933176 15222 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:29.927794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:50175 (local address 127.1.81.254:41179)
0809 02:21:29.927958 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:29.927963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:29.928102 (+ 139us) server_negotiation.cc:407] Connection header received
0809 02:21:29.928236 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:29.928239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:29.928290 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:29.928353 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:29.928842 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.929375 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.930249 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:29.930479 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:29.930564 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:29.933078 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:50175: BlockingRecv error: recv got EOF from 127.1.81.195:50175 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 02:21:30 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:30 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:30.544776 15227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:30.539394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:57611)
0809 02:21:30.539670 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:30.539683 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:30.539783 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:30.540014 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:30.540016 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:30.540205 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:30.540305 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:30.540311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.541021 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.541023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:30.541790 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:30.541806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.542325 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.542328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:30.542397 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:30.542844 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:30.542855 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:30.544652 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":72,"threads_started":1}
W20260809 02:21:30.544968 15228 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:30.539454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:57611 (local address 127.1.81.254:41179)
0809 02:21:30.539682 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:30.539685 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:30.539745 (+ 60us) server_negotiation.cc:407] Connection header received
0809 02:21:30.539869 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:30.539871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:30.539915 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:30.539989 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:30.540386 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.540932 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.541913 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.542218 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.542298 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:30.544769 (+ 2471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:57611: BlockingRecv error: recv got EOF from 127.1.81.193:57611 (error 108)
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":65,"threads_started":1}
Aug 09 02:21:30 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:30 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:30.740691 15229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:30.735755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:54155)
0809 02:21:30.736044 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:30.736058 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:30.736175 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:30.736372 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:30.736373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:30.736558 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:30.736662 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:30.736667 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.737325 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.737327 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:30.737897 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:30.737904 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.738269 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.738272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:30.738339 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:30.738782 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:30.738792 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:30.740568 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":107,"threads_started":1}
W20260809 02:21:30.740828 15228 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:30.735848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:54155 (local address 127.1.81.254:41179)
0809 02:21:30.735990 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:30.735994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:30.736140 (+ 146us) server_negotiation.cc:407] Connection header received
0809 02:21:30.736239 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:30.736241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:30.736286 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:30.736347 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:30.736744 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.737248 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.737974 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.738175 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.738240 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:30.740710 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:54155: BlockingRecv error: recv got EOF from 127.1.81.194:54155 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 02:21:30 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:30 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:30.939049 15230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:30.933960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:52273)
0809 02:21:30.934269 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:30.934286 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:30.934389 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:30.934607 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:30.934609 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:30.934801 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:30.934898 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:30.934903 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.935675 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.935678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:30.936335 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:30.936345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.936741 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.936744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:30.936802 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:30.937236 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:30.937248 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:30.938933 (+ 1685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":101,"threads_started":1}
W20260809 02:21:30.939155 15228 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:30.934017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:52273 (local address 127.1.81.254:41179)
0809 02:21:30.934138 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:30.934142 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:30.934341 (+ 199us) server_negotiation.cc:407] Connection header received
0809 02:21:30.934452 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:30.934454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:30.934502 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:30.934560 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:30.934976 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.935574 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.936432 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:30.936657 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:30.936733 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:30.939054 (+ 2321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:52273: BlockingRecv error: recv got EOF from 127.1.81.195:52273 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 02:21:31 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:31 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:31.550997 15231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:31.545521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:35555)
0809 02:21:31.545930 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:31.545946 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:31.546058 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:31.546438 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:31.546441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:31.546625 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:31.546730 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:31.546736 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.547480 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.547482 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:31.548077 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:31.548087 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.548470 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.548472 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:31.548576 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:31.549069 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:31.549080 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:31.550876 (+ 1796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":92,"threads_started":1}
W20260809 02:21:31.551136 15232 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:31.545591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:35555 (local address 127.1.81.254:41179)
0809 02:21:31.545911 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:31.545916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:31.546009 (+ 93us) server_negotiation.cc:407] Connection header received
0809 02:21:31.546240 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:31.546244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:31.546300 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:31.546406 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:31.546820 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.547344 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.548169 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.548387 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.548458 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:31.551004 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:35555: BlockingRecv error: recv got EOF from 127.1.81.193:35555 (error 108)
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":78,"threads_started":1}
Aug 09 02:21:31 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:31 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:31.746552 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:31.741350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:54485)
0809 02:21:31.741695 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:31.741709 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:31.741806 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:31.741996 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:31.741998 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:31.742179 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:31.742274 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:31.742278 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.742948 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.742950 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:31.743500 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:31.743506 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.744005 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.744008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:31.744075 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:31.744559 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:31.744571 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:31.746391 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":104,"threads_started":1}
W20260809 02:21:31.746636 15232 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:31.741402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:54485 (local address 127.1.81.254:41179)
0809 02:21:31.741566 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:31.741571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:31.741770 (+ 199us) server_negotiation.cc:407] Connection header received
0809 02:21:31.741874 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:31.741876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:31.741920 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:31.741982 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:31.742351 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.742871 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.743596 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.743898 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.743989 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:31.746534 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:54485: BlockingRecv error: recv got EOF from 127.1.81.194:54485 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 02:21:31 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:31 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:31.947086 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:31.939730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:34149)
0809 02:21:31.940051 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:31.940064 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:31.940168 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:31.940366 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:31.940368 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:31.940556 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:31.940654 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:31.940659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.941311 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.941313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:31.941852 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:31.941857 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.942209 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.942211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:31.942268 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:31.945169 (+ 2901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:31.945182 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:31.946948 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":90,"threads_started":1}
W20260809 02:21:31.947258 15232 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:31.939791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:34149 (local address 127.1.81.254:41179)
0809 02:21:31.939919 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:31.939923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:31.940123 (+ 200us) server_negotiation.cc:407] Connection header received
0809 02:21:31.940235 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:31.940237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:31.940279 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:31.940342 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:31.940733 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.941239 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.941927 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:31.942128 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:31.942190 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:31.947086 (+ 4896us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:34149: BlockingRecv error: recv got EOF from 127.1.81.195:34149 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 02:21:32 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:32 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:32.556831 15236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:32.551724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:58931)
0809 02:21:32.552017 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:32.552031 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:32.552122 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:32.552334 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:32.552336 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:32.552516 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:32.552616 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:32.552621 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.553298 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.553299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:32.553862 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:32.553869 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.554218 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.554220 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:32.554274 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:32.554737 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:32.554752 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:32.556707 (+ 1955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":110,"threads_started":1}
W20260809 02:21:32.556943 15237 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:32.551872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:58931 (local address 127.1.81.254:41179)
0809 02:21:32.552117 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:32.552120 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:32.552133 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:32.552198 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:32.552201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:32.552244 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:32.552311 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:32.552705 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.553222 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.553935 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.554142 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.554206 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:32.556830 (+ 2624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:58931: BlockingRecv error: recv got EOF from 127.1.81.193:58931 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":90,"threads_started":1}
Aug 09 02:21:32 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:32 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:32.752878 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:32.747318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:33071)
0809 02:21:32.747593 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:32.747606 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:32.747704 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:32.747972 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:32.747976 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:32.748169 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:32.748272 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:32.748278 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.749237 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.749241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:32.750040 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:32.750051 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.750454 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.750456 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:32.750511 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:32.750940 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:32.750951 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:32.752756 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":99,"threads_started":1}
W20260809 02:21:32.752985 15237 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:32.747381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:33071 (local address 127.1.81.254:41179)
0809 02:21:32.747538 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:32.747543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:32.747672 (+ 129us) server_negotiation.cc:407] Connection header received
0809 02:21:32.747772 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:32.747774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:32.747836 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:32.747898 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:32.748362 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.749108 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.750144 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.750369 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.750446 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:32.752885 (+ 2439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:33071: BlockingRecv error: recv got EOF from 127.1.81.194:33071 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 02:21:32 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:32 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:32.953044 15239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:32.947870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:55955)
0809 02:21:32.948140 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:32.948153 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:32.948272 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:32.948567 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:32.948570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:32.948783 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:32.948891 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:32.948898 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.949655 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.949659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:32.950221 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:32.950229 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.950658 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.950663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:32.950749 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:32.951189 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:32.951200 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:32.952893 (+ 1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":85,"threads_started":1}
W20260809 02:21:32.953135 15237 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:32.947927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:55955 (local address 127.1.81.254:41179)
0809 02:21:32.948051 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:32.948056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:32.948220 (+ 164us) server_negotiation.cc:407] Connection header received
0809 02:21:32.948389 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:32.948392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:32.948443 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:32.948506 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:32.949010 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.949544 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.950332 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:32.950549 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:32.950634 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:32.953034 (+ 2400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:55955: BlockingRecv error: recv got EOF from 127.1.81.195:55955 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:21:33 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:33 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:33.562973 15240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:33.557588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:59929)
0809 02:21:33.557867 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:33.557881 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:33.557969 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:33.558168 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:33.558170 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:33.558345 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:33.558444 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:33.558449 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.559125 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.559127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:33.559696 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:33.559704 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.560195 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.560198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:33.560264 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:33.560690 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:33.560702 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:33.562796 (+ 2094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":90,"threads_started":1}
W20260809 02:21:33.563053 15242 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:33.557645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:59929 (local address 127.1.81.254:41179)
0809 02:21:33.557908 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:33.557912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:33.557924 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:33.558041 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:33.558043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:33.558086 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:33.558158 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:33.558519 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.559052 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.559784 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.560086 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.560165 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:33.562937 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:59929: BlockingRecv error: recv got EOF from 127.1.81.193:59929 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":75,"threads_started":1}
Aug 09 02:21:33 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:33 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:33.758548 15243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:33.753609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:37547)
0809 02:21:33.753900 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:33.753913 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:33.754010 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:33.754208 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:33.754209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:33.754389 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:33.754490 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:33.754496 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.755166 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.755168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:33.755730 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:33.755737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.756139 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.756142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:33.756205 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:33.756685 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:33.756697 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:33.758409 (+ 1712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":88,"threads_started":1}
W20260809 02:21:33.758633 15242 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:33.753700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:37547 (local address 127.1.81.254:41179)
0809 02:21:33.753824 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:33.753827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:33.753971 (+ 144us) server_negotiation.cc:407] Connection header received
0809 02:21:33.754076 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:33.754078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:33.754120 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:33.754183 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:33.754570 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.755089 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.755828 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.756054 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.756127 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:33.758537 (+ 2410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:37547: BlockingRecv error: recv got EOF from 127.1.81.194:37547 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 02:21:33 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:33 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:33.959081 15244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:33.953881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:47839)
0809 02:21:33.954179 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:33.954191 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:33.954298 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:33.954538 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:33.954541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:33.954746 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:33.954842 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:33.954848 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.955587 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.955590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:33.956186 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:33.956196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.956625 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.956629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:33.956717 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:33.957158 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:33.957170 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:33.958966 (+ 1796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":110,"threads_started":1}
W20260809 02:21:33.959288 15242 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:33.953958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:47839 (local address 127.1.81.254:41179)
0809 02:21:33.954081 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:33.954085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:33.954258 (+ 173us) server_negotiation.cc:407] Connection header received
0809 02:21:33.954385 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:33.954388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:33.954438 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:33.954502 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:33.954957 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.955482 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.956299 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:33.956524 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:33.956610 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:33.959170 (+ 2560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:47839: BlockingRecv error: recv got EOF from 127.1.81.195:47839 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:21:34 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:34 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:34.568789 15245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:34.563788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:33875)
0809 02:21:34.564087 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:34.564102 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:34.564197 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:34.564405 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:34.564407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:34.564584 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:34.564695 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:34.564701 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.565418 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.565421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:34.565982 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:34.565990 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.566370 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.566372 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:34.566432 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:34.566851 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:34.566862 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:34.568611 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":70,"threads_started":1}
W20260809 02:21:34.568871 15246 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:34.563857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:33875 (local address 127.1.81.254:41179)
0809 02:21:34.564108 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:34.564113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:34.564166 (+ 53us) server_negotiation.cc:407] Connection header received
0809 02:21:34.564267 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:34.564269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:34.564311 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:34.564384 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:34.564776 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.565334 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.566066 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.566281 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.566345 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:34.568752 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:33875: BlockingRecv error: recv got EOF from 127.1.81.193:33875 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":83,"threads_started":1}
Aug 09 02:21:34 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:34 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:34.764807 15248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:34.759321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:42215)
0809 02:21:34.759614 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:34.759628 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:34.759742 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:34.760001 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:34.760004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:34.760210 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:34.760309 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:34.760316 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.761046 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.761050 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:34.761693 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:34.761703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.762140 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.762143 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:34.762249 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:34.762797 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:34.762809 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:34.764686 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":104,"threads_started":1}
W20260809 02:21:34.764892 15246 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:34.759407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:42215 (local address 127.1.81.254:41179)
0809 02:21:34.759558 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:34.759562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:34.759704 (+ 142us) server_negotiation.cc:407] Connection header received
0809 02:21:34.759846 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:34.759849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:34.759899 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:34.759963 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:34.760419 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.760941 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.761802 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.762030 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.762131 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:34.764796 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:42215: BlockingRecv error: recv got EOF from 127.1.81.194:42215 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 02:21:34 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:34 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:34.965183 15249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:34.959887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:53859)
0809 02:21:34.960138 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:34.960160 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:34.960254 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:34.960454 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:34.960456 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:34.960636 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:34.960736 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:34.960741 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.961409 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.961411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:34.962047 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:34.962060 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.962559 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.962564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:34.962671 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:34.963193 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:34.963206 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:34.965041 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":71,"threads_started":1}
W20260809 02:21:34.965263 15246 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:34.959996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:53859 (local address 127.1.81.254:41179)
0809 02:21:34.960119 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:34.960123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:34.960208 (+ 85us) server_negotiation.cc:407] Connection header received
0809 02:21:34.960327 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:34.960329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:34.960371 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:34.960428 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:34.960818 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.961336 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.962168 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:34.962426 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:34.962530 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:34.965161 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:53859: BlockingRecv error: recv got EOF from 127.1.81.195:53859 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 02:21:35 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:35 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:35.574623 15251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:35.569533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:41101)
0809 02:21:35.569803 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:35.569815 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:35.569905 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:35.570126 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:35.570128 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:35.570311 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:35.570409 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:35.570414 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.571103 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.571104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:35.571680 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:35.571689 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.572078 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.572081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:35.572144 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:35.572595 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:35.572606 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:35.574459 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":88,"threads_started":1}
W20260809 02:21:35.574702 15253 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:35.569607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:41101 (local address 127.1.81.254:41179)
0809 02:21:35.569841 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:35.569845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:35.569858 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:35.569978 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:35.569980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:35.570023 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:35.570102 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:35.570486 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.571015 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.571760 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.571992 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.572067 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:35.574587 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:41101: BlockingRecv error: recv got EOF from 127.1.81.193:41101 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":78,"threads_started":1}
Aug 09 02:21:35 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:35 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:35.770661 15254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:35.765539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:49029)
0809 02:21:35.765809 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:35.765822 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:35.765917 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:35.766115 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:35.766117 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:35.766299 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:35.766399 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:35.766404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.767061 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.767063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:35.767628 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:35.767635 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.768047 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.768051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:35.768158 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:35.768755 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:35.768770 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:35.770539 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":81,"threads_started":1}
W20260809 02:21:35.770767 15253 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:35.765602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:49029 (local address 127.1.81.254:41179)
0809 02:21:35.765727 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:35.765731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:35.765869 (+ 138us) server_negotiation.cc:407] Connection header received
0809 02:21:35.765989 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:35.765992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:35.766034 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:35.766086 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:35.766478 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.766984 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.767707 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.767939 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.768035 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:35.770668 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:49029: BlockingRecv error: recv got EOF from 127.1.81.194:49029 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 02:21:35 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:35 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:35.970682 15256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:35.965889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:57933)
0809 02:21:35.966150 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:35.966163 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:35.966259 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:35.966461 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:35.966463 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:35.966643 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:35.966743 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:35.966748 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.967424 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.967426 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:35.967996 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:35.968004 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.968372 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.968374 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:35.968430 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:35.968858 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:35.968869 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:35.970547 (+ 1678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
W20260809 02:21:35.970789 15253 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:35.965939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:57933 (local address 127.1.81.254:41179)
0809 02:21:35.966070 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:35.966073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:35.966221 (+ 148us) server_negotiation.cc:407] Connection header received
0809 02:21:35.966327 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:35.966329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:35.966373 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:35.966439 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:35.966821 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.967350 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.968077 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:35.968296 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:35.968361 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:35.970675 (+ 2314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:57933: BlockingRecv error: recv got EOF from 127.1.81.195:57933 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 02:21:36 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:36 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:36.580530 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:36.575419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:53057)
0809 02:21:36.575693 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:36.575706 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:36.575816 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:36.576027 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:36.576029 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:36.576220 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:36.576320 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:36.576327 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.577064 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.577069 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:36.577641 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:36.577651 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.578104 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.578108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:36.578208 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:36.578640 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:36.578650 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:36.580414 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":86,"threads_started":1}
W20260809 02:21:36.580687 15258 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:36.575485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:53057 (local address 127.1.81.254:41179)
0809 02:21:36.575723 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:36.575727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:36.575754 (+ 27us) server_negotiation.cc:407] Connection header received
0809 02:21:36.575888 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:36.575890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:36.575933 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:36.576003 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:36.576402 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.576947 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.577759 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.577990 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.578075 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:36.580549 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:53057: BlockingRecv error: recv got EOF from 127.1.81.193:53057 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":57,"threads_started":1}
Aug 09 02:21:36 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:36 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:36.776182 15260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:36.771359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:59749)
0809 02:21:36.771627 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:36.771640 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:36.771738 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:36.771954 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:36.771956 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:36.772135 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:36.772244 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:36.772249 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.772922 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.772924 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:36.773487 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:36.773494 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.773845 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.773847 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:36.773904 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:36.774357 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:36.774368 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:36.776040 (+ 1672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
W20260809 02:21:36.776281 15258 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:36.771412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:59749 (local address 127.1.81.254:41179)
0809 02:21:36.771564 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:36.771569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:36.771702 (+ 133us) server_negotiation.cc:407] Connection header received
0809 02:21:36.771818 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:36.771820 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:36.771865 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:36.771928 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:36.772325 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.772844 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.773563 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.773772 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.773838 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:36.776180 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:59749: BlockingRecv error: recv got EOF from 127.1.81.194:59749 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 02:21:36 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:36 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:36.979491 15261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:36.971362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:38027)
0809 02:21:36.971663 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:36.971676 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:36.971778 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:36.972010 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:36.972012 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:36.972198 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:36.972299 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:36.972304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.972979 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.972981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:36.973528 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:36.973534 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.973888 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.973890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:36.973945 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:36.977406 (+ 3461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:36.977418 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:36.979372 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":90,"threads_started":1}
W20260809 02:21:36.979602 15258 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:36.971433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:38027 (local address 127.1.81.254:41179)
0809 02:21:36.971566 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:36.971569 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:36.971737 (+ 168us) server_negotiation.cc:407] Connection header received
0809 02:21:36.971873 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:36.971875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:36.971920 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:36.971982 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:36.972383 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.972905 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.973605 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:36.973815 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:36.973878 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:36.979500 (+ 5622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:38027: BlockingRecv error: recv got EOF from 127.1.81.195:38027 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 02:21:37 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:37 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:37.586050 15263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:37.581214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:58951)
0809 02:21:37.581470 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:37.581483 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:37.581571 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:37.581775 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:37.581777 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:37.581954 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:37.582049 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:37.582053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.582732 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.582734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:37.583294 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:37.583301 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.583667 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.583670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:37.583729 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:37.584222 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:37.584232 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:37.585920 (+ 1688us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":84,"threads_started":1}
W20260809 02:21:37.586220 15267 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:37.581285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:58951 (local address 127.1.81.254:41179)
0809 02:21:37.581512 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:37.581515 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:37.581528 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:37.581645 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:37.581647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:37.581690 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:37.581763 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:37.582128 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.582657 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.583370 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.583576 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.583640 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:37.586054 (+ 2414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:58951: BlockingRecv error: recv got EOF from 127.1.81.193:58951 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":61,"threads_started":1}
Aug 09 02:21:37 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:37 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:37.782150 15268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:37.776875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:34639)
0809 02:21:37.777133 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:37.777145 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:37.777242 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:37.777492 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:37.777495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:37.777705 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:37.777832 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:37.777840 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.778679 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.778682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:37.779271 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:37.779281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.779659 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.779662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:37.779721 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:37.780239 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:37.780253 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:37.781994 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":72,"threads_started":1}
W20260809 02:21:37.782248 15267 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:37.777008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:34639 (local address 127.1.81.254:41179)
0809 02:21:37.777136 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:37.777147 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:37.777194 (+ 47us) server_negotiation.cc:407] Connection header received
0809 02:21:37.777329 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:37.777331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:37.777373 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:37.777436 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:37.777932 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.778565 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.779363 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.779574 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.779641 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:37.782136 (+ 2495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:34639: BlockingRecv error: recv got EOF from 127.1.81.194:34639 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 02:21:37 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:37 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:37.985127 15269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:37.980211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:42047)
0809 02:21:37.980486 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:37.980499 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:37.980596 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:37.980797 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:37.980799 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:37.980978 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:37.981076 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:37.981082 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.981752 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.981754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:37.982302 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:37.982309 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.982659 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.982661 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:37.982719 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:37.983195 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:37.983208 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:37.984977 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":89,"threads_started":1}
W20260809 02:21:37.985219 15267 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:37.980277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:42047 (local address 127.1.81.254:41179)
0809 02:21:37.980396 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:37.980400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:37.980556 (+ 156us) server_negotiation.cc:407] Connection header received
0809 02:21:37.980664 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:37.980666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:37.980710 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:37.980773 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:37.981161 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.981675 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.982379 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:37.982581 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:37.982646 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:37.985110 (+ 2464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:42047: BlockingRecv error: recv got EOF from 127.1.81.195:42047 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 02:21:38 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:38 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:38.591862 15271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:38.586815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:34649)
0809 02:21:38.587081 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:38.587094 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:38.587204 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:38.587435 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:38.587437 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:38.587618 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:38.587718 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:38.587723 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.588443 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.588446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:38.589010 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:38.589017 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.589390 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.589392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:38.589453 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:38.589905 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:38.589915 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:38.591697 (+ 1782us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":79,"threads_started":1}
W20260809 02:21:38.591975 15272 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:38.586862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:34649 (local address 127.1.81.254:41179)
0809 02:21:38.587143 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:38.587146 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:38.587166 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:21:38.587287 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:38.587289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:38.587332 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:38.587405 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:38.587794 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.588358 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.589095 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.589314 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.589379 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:38.591857 (+ 2478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:34649: BlockingRecv error: recv got EOF from 127.1.81.193:34649 (error 108)
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":71,"threads_started":1}
Aug 09 02:21:38 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:38 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:38.787791 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:38.782893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:41059)
0809 02:21:38.783151 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:38.783169 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:38.783274 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:38.783460 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:38.783462 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:38.783646 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:38.783754 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:38.783759 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.784457 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.784460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:38.785031 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:38.785040 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.785383 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.785386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:38.785443 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:38.785883 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:38.785893 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:38.787641 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":75,"threads_started":1}
W20260809 02:21:38.787940 15272 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:38.782939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:41059 (local address 127.1.81.254:41179)
0809 02:21:38.783073 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:38.783078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:38.783234 (+ 156us) server_negotiation.cc:407] Connection header received
0809 02:21:38.783337 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:38.783339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:38.783385 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:38.783446 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:38.783862 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.784370 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.785111 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.785311 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.785374 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:38.787797 (+ 2423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:41059: BlockingRecv error: recv got EOF from 127.1.81.194:41059 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:21:38 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:38 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.195@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:38.991133 15277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:38.985881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.195:59015)
0809 02:21:38.986206 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:38.986219 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:38.986326 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:38.986560 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:38.986563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:38.986778 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:38.986893 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:38.986902 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.987683 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.987686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:38.988292 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:38.988302 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.988742 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.988745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:38.988831 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:38.989273 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:38.989284 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:38.991018 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":85,"threads_started":1}
W20260809 02:21:38.991266 15272 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:38.985959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:59015 (local address 127.1.81.254:41179)
0809 02:21:38.986091 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:38.986096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:38.986280 (+ 184us) server_negotiation.cc:407] Connection header received
0809 02:21:38.986409 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:38.986413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:38.986463 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:38.986527 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:38.987010 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.987575 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.988407 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:38.988634 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:38.988727 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:38.991156 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.195:59015: BlockingRecv error: recv got EOF from 127.1.81.195:59015 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 02:21:39 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:39 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.193@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:39.597851 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:39.592684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.193:51315)
0809 02:21:39.592952 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:39.592966 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:39.593048 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:39.593273 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:39.593275 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:39.593458 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:39.593554 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:39.593559 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:39.594239 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:39.594241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:39.594805 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:39.594811 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:39.595171 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:39.595173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:39.595232 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:39.595681 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:39.595692 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:39.597722 (+ 2030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":85,"threads_started":1}
W20260809 02:21:39.597978 15280 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:39.592756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:51315 (local address 127.1.81.254:41179)
0809 02:21:39.592997 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:39.593000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:39.593013 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:39.593122 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:39.593125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:39.593177 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:39.593249 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:39.593636 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:39.594164 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:39.594879 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:39.595085 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:39.595157 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:39.597848 (+ 2691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.193:51315: BlockingRecv error: recv got EOF from 127.1.81.193:51315 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":79,"threads_started":1}
Aug 09 02:21:39 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:21:39 dist-test-slave-jlzn krb5kdc[13623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.81.194@KRBTEST.COM for oryx/127.1.81.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:21:39.793497 15283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:39.788637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41179 (local address 127.1.81.194:41465)
0809 02:21:39.788914 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:39.788927 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:39.789023 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:39.789223 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:39.789224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:39.789413 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:39.789509 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:39.789514 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:39.790173 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:39.790175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:39.790741 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:39.790748 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:39.791096 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:39.791098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:39.791157 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:39.791606 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:39.791617 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:39.793377 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.81.254:41179: Server oryx/127.1.81.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":80,"threads_started":1}
W20260809 02:21:39.793632 15280 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:39.788717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:41465 (local address 127.1.81.254:41179)
0809 02:21:39.788834 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:39.788838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:39.788988 (+ 150us) server_negotiation.cc:407] Connection header received
0809 02:21:39.789084 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:39.789087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:39.789127 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:39.789200 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:39.789591 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:39.790093 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:39.790819 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:39.791024 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:39.791089 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:39.793512 (+ 2423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.81.194:41465: BlockingRecv error: recv got EOF from 127.1.81.194:41465 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:21:39.885933 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 14510
I20260809 02:21:39.898128 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 14762
I20260809 02:21:39.911976 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 14977
I20260809 02:21:39.923214 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 14399
2026-08-09T02:21:39Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18018 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T02:21:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:39Z Disabled control of system clock
I20260809 02:21:39.956193 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:36817
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:44037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:36817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 02:21:40.061476 15294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:40.061693 15294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:40.061723 15294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:40.065516 15294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:40.065557 15294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:40.065572 15294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:40.065593 15294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:40.065606 15294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:40.070060 15294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:36817
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:36817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:40.070890 15294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:40.072093 15294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:40.080068 15301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:40.080227 15305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:40.080157 15294 server_base.cc:1034] running on GCE node
W20260809 02:21:40.080108 15302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:40.080834 15294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:40.081820 15294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:40.082981 15294 hybrid_clock.cc:648] HybridClock initialized: now 1786242100082965 us; error 27 us; skew 500 ppm
I20260809 02:21:40.084728 15294 webserver.cc:460] Webserver started at http://127.1.81.254:37751/ using document root <none> and password file <none>
I20260809 02:21:40.085250 15294 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:40.085317 15294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:40.085520 15294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:40.087399 15294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "6097405fd7eb4470ae2cb5001448da53"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "7ba60e7113bdc57316ea818b961deecd"
server_key_iv: "7fd7d29fc69ee0cac4b80523882066ad"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.087939 15294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "6097405fd7eb4470ae2cb5001448da53"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "7ba60e7113bdc57316ea818b961deecd"
server_key_iv: "7fd7d29fc69ee0cac4b80523882066ad"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.091238 15294 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:21:40.093417 15314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.094457 15294 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 02:21:40.094581 15294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "6097405fd7eb4470ae2cb5001448da53"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "7ba60e7113bdc57316ea818b961deecd"
server_key_iv: "7fd7d29fc69ee0cac4b80523882066ad"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.094672 15294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:40.131146 15294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:40.131856 15294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:40.132028 15294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:40.138474 15294 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:36817
I20260809 02:21:40.138495 15387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:36817 every 8 connection(s)
I20260809 02:21:40.139353 15294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:40.140910 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 15294
I20260809 02:21:40.141019 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:40.141299 1351 external_mini_cluster.cc:1428] Setting key 518c245b3997ef593cc0aba1bc37c4e7
I20260809 02:21:40.142727 15389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:40.148618 15389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53: Bootstrap starting.
I20260809 02:21:40.150444 15393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:40.142576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34302 (local address 127.1.81.254:36817)
0809 02:21:40.143179 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:40.143194 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:40.143231 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:21:40.143931 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:40.143950 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:40.144315 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:40.144573 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:40.144937 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.145884 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.147047 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.147559 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.147683 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:40.148530 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:40.148535 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:40.148546 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:40.148938 (+ 392us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:40.148995 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:40.149016 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:40.149088 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:40.149257 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 02:21:40.149532 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":112,"threads_started":1}
I20260809 02:21:40.151073 15389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:40.151988 15389 log.cc:824] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:40.153839 15389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53: No bootstrap required, opened a new log
I20260809 02:21:40.157313 15389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6097405fd7eb4470ae2cb5001448da53" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36817 } }
I20260809 02:21:40.157516 15389 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:40.157554 15389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6097405fd7eb4470ae2cb5001448da53, State: Initialized, Role: FOLLOWER
I20260809 02:21:40.157917 15389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6097405fd7eb4470ae2cb5001448da53" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36817 } }
I20260809 02:21:40.158046 15389 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:40.158093 15389 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:40.158169 15389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:40.158934 15389 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6097405fd7eb4470ae2cb5001448da53" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36817 } }
I20260809 02:21:40.159222 15389 leader_election.cc:302] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6097405fd7eb4470ae2cb5001448da53; no voters:
I20260809 02:21:40.159454 15389 leader_election.cc:288] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:40.159561 15397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:40.159895 15397 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [term 1 LEADER]: Becoming Leader. State: Replica: 6097405fd7eb4470ae2cb5001448da53, State: Running, Role: LEADER
I20260809 02:21:40.160231 15397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6097405fd7eb4470ae2cb5001448da53" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36817 } }
I20260809 02:21:40.160542 15389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:40.161885 15400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6097405fd7eb4470ae2cb5001448da53. Latest consensus state: current_term: 1 leader_uuid: "6097405fd7eb4470ae2cb5001448da53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6097405fd7eb4470ae2cb5001448da53" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36817 } } }
I20260809 02:21:40.161995 15400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:40.162304 15399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6097405fd7eb4470ae2cb5001448da53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6097405fd7eb4470ae2cb5001448da53" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36817 } } }
I20260809 02:21:40.162384 15410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:40.162427 15399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:40.165055 15410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:40.169858 15410 catalog_manager.cc:1347] Generated new cluster ID: 6c7c094d43484dcb997ec3fa8a221fe3
I20260809 02:21:40.169924 15410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:40.182354 15410 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:40.183125 15410 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:40.188562 15410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6097405fd7eb4470ae2cb5001448da53: Generated new TSK 0
I20260809 02:21:40.189097 15410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:21:40.196319 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36817
--builtin_ntp_servers=127.1.81.212:44037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 02:21:40.306098 15423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:40.306327 15423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:40.306361 15423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:40.310254 15423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:40.310302 15423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:40.310364 15423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:40.314965 15423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:40.315908 15423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:40.317173 15423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:40.326558 15430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:40.326609 15423 server_base.cc:1034] running on GCE node
W20260809 02:21:40.326622 15433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:40.326561 15431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:40.327123 15423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:40.327713 15423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:40.328866 15423 hybrid_clock.cc:648] HybridClock initialized: now 1786242100328852 us; error 28 us; skew 500 ppm
I20260809 02:21:40.330550 15423 webserver.cc:460] Webserver started at http://127.1.81.193:43571/ using document root <none> and password file <none>
I20260809 02:21:40.331064 15423 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:40.331131 15423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:40.331314 15423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:40.333254 15423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "69827b4122fc41fba8017fb441cd10ae"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "fbef7e1aac9124ad3965cadcca8ff681"
server_key_iv: "10726d2806be0e2024ad4c59ae800977"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.333774 15423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "69827b4122fc41fba8017fb441cd10ae"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "fbef7e1aac9124ad3965cadcca8ff681"
server_key_iv: "10726d2806be0e2024ad4c59ae800977"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.337139 15423 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 02:21:40.339318 15440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.340426 15423 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:40.340544 15423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "69827b4122fc41fba8017fb441cd10ae"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "fbef7e1aac9124ad3965cadcca8ff681"
server_key_iv: "10726d2806be0e2024ad4c59ae800977"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.340636 15423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:40.352185 15423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:40.352746 15423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:40.352896 15423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:40.353394 15423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:40.354233 15423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:40.354281 15423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.354329 15423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:40.354357 15423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.362658 15423 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:35473
I20260809 02:21:40.362707 15630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:35473 every 8 connection(s)
I20260809 02:21:40.363447 15423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:40.371342 15393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:40.365022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:33445 (local address 127.1.81.254:36817)
0809 02:21:40.365188 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:40.365194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:40.366132 (+ 938us) server_negotiation.cc:407] Connection header received
0809 02:21:40.367352 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:40.367355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:40.367405 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:40.367474 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:40.368258 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.368778 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.369810 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.370026 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.370093 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:40.370962 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:40.370965 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:40.370967 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:40.370980 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:40.371000 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:40.371008 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:40.371062 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:40.371168 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 02:21:40.371228 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:21:40.372080 15633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:40.365381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36817 (local address 127.1.81.193:33445)
0809 02:21:40.365995 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:40.366031 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:40.367187 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:40.367607 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:40.367612 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:40.367696 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:40.368147 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:40.368159 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.368866 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.368868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:40.369720 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:40.369729 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.370128 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.370130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:40.370260 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:40.370736 (+ 476us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:40.370737 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:40.370773 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:40.370830 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:40.371067 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:40.371071 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:40.371075 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:40.371154 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 02:21:40.371345 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
I20260809 02:21:40.373081 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 15423
I20260809 02:21:40.373123 15631 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36817
I20260809 02:21:40.373199 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:40.373325 15631 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:40.373471 1351 external_mini_cluster.cc:1428] Setting key d1c5543086bb0e87134fe0f6e0a5dcab
I20260809 02:21:40.373802 15631 heartbeater.cc:511] Master 127.1.81.254:36817 requested a full tablet report, sending...
I20260809 02:21:40.375265 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36817
--builtin_ntp_servers=127.1.81.212:44037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 02:21:40.375257 15338 ts_manager.cc:194] Registered new tserver with Master: 69827b4122fc41fba8017fb441cd10ae (127.1.81.193:35473)
I20260809 02:21:40.376674 15338 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.193:33445
W20260809 02:21:40.485008 15634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:40.485258 15634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:40.485311 15634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:40.489107 15634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:40.489156 15634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:40.489226 15634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:40.493714 15634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:40.494594 15634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:40.495818 15634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:40.504545 15645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:40.504576 15643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:40.504588 15641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:40.504791 15634 server_base.cc:1034] running on GCE node
I20260809 02:21:40.505216 15634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:40.505759 15634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:40.506910 15634 hybrid_clock.cc:648] HybridClock initialized: now 1786242100506891 us; error 29 us; skew 500 ppm
I20260809 02:21:40.508562 15634 webserver.cc:460] Webserver started at http://127.1.81.194:45647/ using document root <none> and password file <none>
I20260809 02:21:40.509055 15634 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:40.509120 15634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:40.509323 15634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:40.511124 15634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "4b5a460589da4f35ac7f32a90c37f042"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "08e43545b15f9ec30a21b90614a248bd"
server_key_iv: "bca11583e62b26eb5a79971f09f64028"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.511653 15634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "4b5a460589da4f35ac7f32a90c37f042"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "08e43545b15f9ec30a21b90614a248bd"
server_key_iv: "bca11583e62b26eb5a79971f09f64028"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.514943 15634 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:21:40.517174 15654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.518225 15634 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:40.518330 15634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "4b5a460589da4f35ac7f32a90c37f042"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "08e43545b15f9ec30a21b90614a248bd"
server_key_iv: "bca11583e62b26eb5a79971f09f64028"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.518420 15634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:40.531666 15634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:40.532255 15634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:40.532409 15634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:40.532904 15634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:40.533733 15634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:40.533782 15634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.533829 15634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:40.533859 15634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.541863 15634 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:43059
I20260809 02:21:40.541891 15836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:43059 every 8 connection(s)
I20260809 02:21:40.542618 15634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:40.551043 15393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:40.544239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:59465 (local address 127.1.81.254:36817)
0809 02:21:40.544359 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:40.544362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:40.545297 (+ 935us) server_negotiation.cc:407] Connection header received
0809 02:21:40.546657 (+ 1360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:40.546661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:40.546720 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:40.546789 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:40.547600 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.548163 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.549244 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.549457 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.549546 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:40.550588 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:40.550591 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:40.550593 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:40.550604 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:40.550622 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:40.550630 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:40.550690 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:40.550827 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 02:21:40.550895 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:21:40.551503 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 15634
I20260809 02:21:40.551614 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:40.551843 15842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:40.544545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36817 (local address 127.1.81.194:59465)
0809 02:21:40.545168 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:40.545208 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:40.546433 (+ 1225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:40.546960 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:40.546966 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:40.547043 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:40.547462 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:40.547474 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.548285 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.548290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:40.549123 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:40.549133 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.549593 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.549597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:40.549753 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:40.550339 (+ 586us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:40.550341 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:40.550383 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:40.550443 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:40.550701 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:40.550711 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:40.550717 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:21:40.550817 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 02:21:40.551063 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":117,"threads_started":1}
I20260809 02:21:40.551915 1351 external_mini_cluster.cc:1428] Setting key 22ce1f6f9b75b4e9200b932c3e886297
I20260809 02:21:40.552910 15838 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36817
I20260809 02:21:40.553139 15838 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:40.553617 15838 heartbeater.cc:511] Master 127.1.81.254:36817 requested a full tablet report, sending...
I20260809 02:21:40.553813 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36817
--builtin_ntp_servers=127.1.81.212:44037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 02:21:40.554569 15338 ts_manager.cc:194] Registered new tserver with Master: 4b5a460589da4f35ac7f32a90c37f042 (127.1.81.194:43059)
I20260809 02:21:40.555084 15338 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.194:59465
W20260809 02:21:40.661116 15844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:40.661337 15844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:40.661370 15844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:40.665294 15844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:40.665340 15844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:40.665395 15844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:40.669898 15844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:40.670735 15844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:40.671944 15844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:40.680570 15857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:40.680570 15855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:40.680617 15852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:40.680823 15844 server_base.cc:1034] running on GCE node
I20260809 02:21:40.681221 15844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:40.681762 15844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:40.682917 15844 hybrid_clock.cc:648] HybridClock initialized: now 1786242100682899 us; error 32 us; skew 500 ppm
I20260809 02:21:40.684576 15844 webserver.cc:460] Webserver started at http://127.1.81.195:45317/ using document root <none> and password file <none>
I20260809 02:21:40.685086 15844 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:40.685153 15844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:40.685334 15844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:40.687179 15844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "ec91d1f1421e4a848ee30cdb2c1da3fb"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "3d6cca93090fc4900b849ad0e0f95837"
server_key_iv: "329a5a18bb3028a0d052d5331b34db1f"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.687702 15844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "ec91d1f1421e4a848ee30cdb2c1da3fb"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "3d6cca93090fc4900b849ad0e0f95837"
server_key_iv: "329a5a18bb3028a0d052d5331b34db1f"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.691149 15844 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:21:40.693384 15864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.694427 15844 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:40.694542 15844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "ec91d1f1421e4a848ee30cdb2c1da3fb"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "3d6cca93090fc4900b849ad0e0f95837"
server_key_iv: "329a5a18bb3028a0d052d5331b34db1f"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.694635 15844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:40.713341 15844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:40.713896 15844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:40.714047 15844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:40.714546 15844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:40.715390 15844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:40.715437 15844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.715487 15844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:40.715514 15844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.723749 15844 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:36363
I20260809 02:21:40.723827 16048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:36363 every 8 connection(s)
I20260809 02:21:40.724540 15844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:40.730115 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 15844
I20260809 02:21:40.730221 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:40.730453 1351 external_mini_cluster.cc:1428] Setting key 1746e0b92325eeba21aeb0facad3721d
I20260809 02:21:40.732834 15393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:40.726084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:53749 (local address 127.1.81.254:36817)
0809 02:21:40.726196 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:40.726200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:40.727143 (+ 943us) server_negotiation.cc:407] Connection header received
0809 02:21:40.728415 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:40.728418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:40.728467 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:40.728536 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:40.729282 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.729784 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.730946 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.731234 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.731325 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:40.732408 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:40.732412 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:40.732415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:40.732428 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:40.732454 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:40.732464 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:40.732527 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:40.732672 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 02:21:40.732726 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:21:40.733560 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:40.726401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36817 (local address 127.1.81.195:53749)
0809 02:21:40.727013 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:40.727051 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:40.728249 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:40.728674 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:40.728680 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:40.728755 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:40.729176 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:40.729187 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.729870 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.729873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:40.730820 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:40.730832 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:40.731392 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:40.731397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:40.731568 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:40.732113 (+ 545us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:40.732115 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:40.732167 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:40.732243 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:40.732543 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:40.732551 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:40.732556 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:21:40.732659 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 02:21:40.732857 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":105,"threads_started":1}
I20260809 02:21:40.734524 16051 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36817
I20260809 02:21:40.734712 16051 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:40.735121 16051 heartbeater.cc:511] Master 127.1.81.254:36817 requested a full tablet report, sending...
I20260809 02:21:40.736001 15338 ts_manager.cc:194] Registered new tserver with Master: ec91d1f1421e4a848ee30cdb2c1da3fb (127.1.81.195:36363)
I20260809 02:21:40.736505 15338 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.195:53749
I20260809 02:21:40.744081 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:21:40.746657 15393 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:40.745778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34318 (local address 127.1.81.254:36817)
0809 02:21:40.745885 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:40.745889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:40.746063 (+ 174us) server_negotiation.cc:407] Connection header received
0809 02:21:40.746180 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:40.746183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:40.746225 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:40.746287 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:40.746539 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34318: BlockingRecv error: recv got EOF from 127.0.0.1:34318 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:21:40.746801 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 15423
I20260809 02:21:40.758952 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 15634
I20260809 02:21:40.781559 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 15844
I20260809 02:21:40.798940 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 15294
2026-08-09T02:21:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (873 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T02:21:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:40Z Disabled control of system clock
I20260809 02:21:40.829353 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43821
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:43821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 02:21:40.937721 16065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:40.937953 16065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:40.937989 16065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:40.941869 16065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:40.941917 16065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:40.941932 16065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:40.941962 16065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:40.941987 16065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:40.946497 16065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:43821
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:40.947414 16065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:40.948705 16065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:40.956538 16077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:40.956511 16075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:40.956540 16074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:40.956715 16065 server_base.cc:1034] running on GCE node
I20260809 02:21:40.957374 16065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:40.958374 16065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:40.959537 16065 hybrid_clock.cc:648] HybridClock initialized: now 1786242100959522 us; error 30 us; skew 500 ppm
I20260809 02:21:40.961210 16065 webserver.cc:460] Webserver started at http://127.1.81.254:46735/ using document root <none> and password file <none>
I20260809 02:21:40.961719 16065 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:40.961786 16065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:40.961987 16065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:40.963915 16065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "100d25e999d04a96ae5b0865d73b9019"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "ee5f68f0d962500bcc21521a0942f977"
server_key_iv: "ca6779fe0b7aa78af1c7dc870b36f309"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.964433 16065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "100d25e999d04a96ae5b0865d73b9019"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "ee5f68f0d962500bcc21521a0942f977"
server_key_iv: "ca6779fe0b7aa78af1c7dc870b36f309"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.967711 16065 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:21:40.969916 16091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:40.970988 16065 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:40.971100 16065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "100d25e999d04a96ae5b0865d73b9019"
format_stamp: "Formatted at 2026-08-09 02:21:40 on dist-test-slave-jlzn"
server_key: "ee5f68f0d962500bcc21521a0942f977"
server_key_iv: "ca6779fe0b7aa78af1c7dc870b36f309"
server_key_version: "encryptionkey@0"
I20260809 02:21:40.971189 16065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:40.975368 16065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:40.975927 16065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:40.976078 16065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:40.982374 16065 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:43821
I20260809 02:21:40.982393 16170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:43821 every 8 connection(s)
I20260809 02:21:40.983157 16065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:40.983843 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 16065
I20260809 02:21:40.983958 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:40.984238 1351 external_mini_cluster.cc:1428] Setting key c47542daf3487a21e60b78302368d35d
I20260809 02:21:40.986399 16171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:40.989773 16178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:40.985496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32962 (local address 127.1.81.254:43821)
0809 02:21:40.986674 (+ 1178us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:40.986693 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:40.986727 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:21:40.987322 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:40.987337 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:40.987639 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:40.987946 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:40.988684 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:40.988688 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:40.988699 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:40.988709 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:40.988760 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:40.988775 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:40.988897 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:40.988963 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 02:21:40.989183 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":837,"thread_start_us":667,"threads_started":1}
I20260809 02:21:40.991989 16171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019: Bootstrap starting.
I20260809 02:21:40.993899 16171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:40.994580 16171 log.cc:824] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:40.996325 16171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019: No bootstrap required, opened a new log
I20260809 02:21:40.999536 16171 raft_consensus.cc:348] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100d25e999d04a96ae5b0865d73b9019" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43821 } }
I20260809 02:21:40.999729 16171 raft_consensus.cc:374] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:40.999787 16171 raft_consensus.cc:729] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 100d25e999d04a96ae5b0865d73b9019, State: Initialized, Role: FOLLOWER
I20260809 02:21:41.000200 16171 consensus_queue.cc:260] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100d25e999d04a96ae5b0865d73b9019" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43821 } }
I20260809 02:21:41.000329 16171 raft_consensus.cc:388] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:41.000392 16171 raft_consensus.cc:482] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:41.000483 16171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:41.001282 16171 raft_consensus.cc:504] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100d25e999d04a96ae5b0865d73b9019" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43821 } }
I20260809 02:21:41.001573 16171 leader_election.cc:302] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 100d25e999d04a96ae5b0865d73b9019; no voters:
I20260809 02:21:41.001824 16171 leader_election.cc:288] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:41.001905 16180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:41.002110 16180 raft_consensus.cc:686] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [term 1 LEADER]: Becoming Leader. State: Replica: 100d25e999d04a96ae5b0865d73b9019, State: Running, Role: LEADER
I20260809 02:21:41.002427 16180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100d25e999d04a96ae5b0865d73b9019" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43821 } }
I20260809 02:21:41.002964 16171 sys_catalog.cc:564] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:41.004213 16182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 100d25e999d04a96ae5b0865d73b9019. Latest consensus state: current_term: 1 leader_uuid: "100d25e999d04a96ae5b0865d73b9019" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100d25e999d04a96ae5b0865d73b9019" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43821 } } }
I20260809 02:21:41.004215 16181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "100d25e999d04a96ae5b0865d73b9019" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100d25e999d04a96ae5b0865d73b9019" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43821 } } }
I20260809 02:21:41.004354 16182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:41.004359 16181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:41.004701 16196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:41.007499 16196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:41.012691 16196 catalog_manager.cc:1347] Generated new cluster ID: 89a20152c6654955b0d932ba18600c9c
I20260809 02:21:41.012741 16196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:41.026286 16196 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:41.026576 16196 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:41.032029 16196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 100d25e999d04a96ae5b0865d73b9019: Generated new TSK 0
I20260809 02:21:41.032651 16196 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:21:41.044634 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43821
--builtin_ntp_servers=127.1.81.212:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 02:21:41.152016 16214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:41.152243 16214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:41.152295 16214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:41.156116 16214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:41.156158 16214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:41.156229 16214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:41.160741 16214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:41.161655 16214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:41.162884 16214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:41.171772 16224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:41.171777 16222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:41.171846 16214 server_base.cc:1034] running on GCE node
W20260809 02:21:41.171854 16220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:41.172391 16214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:41.172976 16214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:41.174129 16214 hybrid_clock.cc:648] HybridClock initialized: now 1786242101174118 us; error 27 us; skew 500 ppm
I20260809 02:21:41.175853 16214 webserver.cc:460] Webserver started at http://127.1.81.193:36941/ using document root <none> and password file <none>
I20260809 02:21:41.176366 16214 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:41.176426 16214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:41.176610 16214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:41.178506 16214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "8bdc92e650b5479aa5f84bb73bc001f9"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "5cf0e0f4ceca0def461814066f04d0dc"
server_key_iv: "616670cfcafe5474a75e0b0115c306fa"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.179028 16214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "8bdc92e650b5479aa5f84bb73bc001f9"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "5cf0e0f4ceca0def461814066f04d0dc"
server_key_iv: "616670cfcafe5474a75e0b0115c306fa"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.182446 16214 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:21:41.184715 16232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.185808 16214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:41.185913 16214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "8bdc92e650b5479aa5f84bb73bc001f9"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "5cf0e0f4ceca0def461814066f04d0dc"
server_key_iv: "616670cfcafe5474a75e0b0115c306fa"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.186005 16214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:41.190235 16214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:41.190785 16214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:41.190932 16214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:41.191433 16214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:41.192335 16214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:41.192384 16214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.192432 16214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:41.192458 16214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.200644 16214 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:35531
I20260809 02:21:41.200675 16404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:35531 every 8 connection(s)
I20260809 02:21:41.201411 16214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:41.207002 16178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:41.203004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:41355 (local address 127.1.81.254:43821)
0809 02:21:41.203146 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:41.203150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:41.204204 (+ 1054us) server_negotiation.cc:407] Connection header received
0809 02:21:41.205504 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:41.205508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:41.205553 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:41.205626 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:41.206573 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:41.206576 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:41.206579 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:41.206592 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:41.206612 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:41.206620 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:41.206703 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:41.206822 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 02:21:41.206868 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:21:41.207746 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:41.203366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43821 (local address 127.1.81.193:41355)
0809 02:21:41.204048 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:41.204095 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:41.205310 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:41.205793 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:41.205800 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:41.205880 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:41.206332 (+ 452us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:41.206333 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:41.206370 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:41.206432 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:41.206688 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:41.206697 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:41.206702 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:21:41.206854 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 02:21:41.207076 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":107,"threads_started":1}
I20260809 02:21:41.208837 16405 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43821
I20260809 02:21:41.209039 16405 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:41.209393 16405 heartbeater.cc:511] Master 127.1.81.254:43821 requested a full tablet report, sending...
I20260809 02:21:41.210738 16116 ts_manager.cc:194] Registered new tserver with Master: 8bdc92e650b5479aa5f84bb73bc001f9 (127.1.81.193:35531)
I20260809 02:21:41.211489 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 16214
I20260809 02:21:41.211597 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:41.211931 1351 external_mini_cluster.cc:1428] Setting key 76dacadee4e027c56c323e2c452efaf6
I20260809 02:21:41.213694 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43821
--builtin_ntp_servers=127.1.81.212:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 02:21:41.321000 16416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:41.321228 16416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:41.321267 16416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:41.325227 16416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:41.325274 16416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:41.325338 16416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:41.329860 16416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:41.330758 16416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:41.332065 16416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:41.341142 16423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:41.341156 16428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:41.341179 16425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:41.341318 16416 server_base.cc:1034] running on GCE node
I20260809 02:21:41.341778 16416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:41.342365 16416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:41.343524 16416 hybrid_clock.cc:648] HybridClock initialized: now 1786242101343509 us; error 27 us; skew 500 ppm
I20260809 02:21:41.345194 16416 webserver.cc:460] Webserver started at http://127.1.81.194:41947/ using document root <none> and password file <none>
I20260809 02:21:41.345716 16416 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:41.345782 16416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:41.345958 16416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:41.347878 16416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "47a88acba55644309f9a01637206566e"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "349dd8287ab9cb17ef46a25f8e7ae69f"
server_key_iv: "5d30b608867201345aa1ac602542a63a"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.348452 16416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "47a88acba55644309f9a01637206566e"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "349dd8287ab9cb17ef46a25f8e7ae69f"
server_key_iv: "5d30b608867201345aa1ac602542a63a"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.351847 16416 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 02:21:41.354097 16437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.355201 16416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:41.355325 16416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "47a88acba55644309f9a01637206566e"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "349dd8287ab9cb17ef46a25f8e7ae69f"
server_key_iv: "5d30b608867201345aa1ac602542a63a"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.355419 16416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:41.359599 16416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:41.360217 16416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:41.360375 16416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:41.360877 16416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:41.361727 16416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:41.361774 16416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.361824 16416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:41.361852 16416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.369931 16416 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:45329
I20260809 02:21:41.369953 16620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:45329 every 8 connection(s)
I20260809 02:21:41.370718 16416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:41.376163 16178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:41.372373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:55301 (local address 127.1.81.254:43821)
0809 02:21:41.372512 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:41.372517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:41.373469 (+ 952us) server_negotiation.cc:407] Connection header received
0809 02:21:41.374697 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:41.374699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:41.374738 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:41.374807 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:41.375797 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:41.375819 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:41.375821 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:41.375831 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:41.375847 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:41.375855 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:41.375923 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:41.376025 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 02:21:41.376058 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:21:41.376897 16624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:41.372741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43821 (local address 127.1.81.194:55301)
0809 02:21:41.373343 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:41.373379 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:41.374522 (+ 1143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:41.374941 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:41.374947 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:41.375025 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:41.375553 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:41.375555 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:41.375604 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:41.375683 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:41.375922 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:41.375928 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:41.375932 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:41.376056 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 02:21:41.376237 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":105,"threads_started":1}
I20260809 02:21:41.377842 16621 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43821
I20260809 02:21:41.378038 16621 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:41.378398 16621 heartbeater.cc:511] Master 127.1.81.254:43821 requested a full tablet report, sending...
I20260809 02:21:41.379297 16116 ts_manager.cc:194] Registered new tserver with Master: 47a88acba55644309f9a01637206566e (127.1.81.194:45329)
I20260809 02:21:41.379549 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 16416
I20260809 02:21:41.379671 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:41.380015 1351 external_mini_cluster.cc:1428] Setting key 1eb7f2025093e13dc56c8875a450ccb5
I20260809 02:21:41.381709 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43821
--builtin_ntp_servers=127.1.81.212:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 02:21:41.491699 16625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:41.491950 16625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:41.492000 16625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:41.495860 16625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:41.495908 16625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:41.495972 16625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:41.500552 16625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:41.501416 16625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:41.502629 16625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:41.511346 16636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:41.511348 16633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:41.511391 16632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:41.511724 16625 server_base.cc:1034] running on GCE node
I20260809 02:21:41.512094 16625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:41.512637 16625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:41.513784 16625 hybrid_clock.cc:648] HybridClock initialized: now 1786242101513769 us; error 27 us; skew 500 ppm
I20260809 02:21:41.515404 16625 webserver.cc:460] Webserver started at http://127.1.81.195:41745/ using document root <none> and password file <none>
I20260809 02:21:41.515964 16625 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:41.516028 16625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:41.516219 16625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:41.518074 16625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "de88a9cc84314499bb5f3efce99b1910"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "cf710c8bc57b265ff32aa560debe3b9f"
server_key_iv: "acc169962d8e9cda40340a3240d3ba0e"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.518594 16625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "de88a9cc84314499bb5f3efce99b1910"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "cf710c8bc57b265ff32aa560debe3b9f"
server_key_iv: "acc169962d8e9cda40340a3240d3ba0e"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.521931 16625 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260809 02:21:41.524140 16646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.525208 16625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:21:41.525302 16625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "de88a9cc84314499bb5f3efce99b1910"
format_stamp: "Formatted at 2026-08-09 02:21:41 on dist-test-slave-jlzn"
server_key: "cf710c8bc57b265ff32aa560debe3b9f"
server_key_iv: "acc169962d8e9cda40340a3240d3ba0e"
server_key_version: "encryptionkey@0"
I20260809 02:21:41.525399 16625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:41.529627 16625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:41.530172 16625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:41.530318 16625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:41.530803 16625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:41.531651 16625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:41.531699 16625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.531756 16625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:41.531785 16625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:41.540074 16625 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:34551
I20260809 02:21:41.540104 16813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:34551 every 8 connection(s)
I20260809 02:21:41.540853 16625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:41.546098 16178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:41.542412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:53921 (local address 127.1.81.254:43821)
0809 02:21:41.542535 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:41.542539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:41.543473 (+ 934us) server_negotiation.cc:407] Connection header received
0809 02:21:41.544720 (+ 1247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:41.544723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:41.544768 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:41.544828 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:41.545746 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:41.545748 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:41.545751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:21:41.545761 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:41.545781 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:21:41.545789 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:41.545858 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:41.545955 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:21:41.545991 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:21:41.546834 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:41.542751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43821 (local address 127.1.81.195:53921)
0809 02:21:41.543348 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:41.543383 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:41.544530 (+ 1147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:41.544962 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:41.544968 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:41.545046 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:41.545518 (+ 472us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:21:41.545520 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:41.545555 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:21:41.545618 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:41.545850 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:41.545855 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:41.545858 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:21:41.545971 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 02:21:41.546141 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":101,"threads_started":1}
I20260809 02:21:41.547849 16815 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43821
I20260809 02:21:41.548036 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 16625
I20260809 02:21:41.548079 16815 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:41.548141 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:41.548462 1351 external_mini_cluster.cc:1428] Setting key e55b26a1ef510c75d9008f4af49411b5
I20260809 02:21:41.548496 16815 heartbeater.cc:511] Master 127.1.81.254:43821 requested a full tablet report, sending...
I20260809 02:21:41.549520 16116 ts_manager.cc:194] Registered new tserver with Master: de88a9cc84314499bb5f3efce99b1910 (127.1.81.195:34551)
I20260809 02:21:41.550400 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:21:41.553210 16178 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:41.552326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32974 (local address 127.1.81.254:43821)
0809 02:21:41.552436 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:41.552439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:41.552640 (+ 201us) server_negotiation.cc:407] Connection header received
0809 02:21:41.552731 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:41.552733 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:41.552758 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:41.552820 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:41.553099 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32974: BlockingRecv error: recv got EOF from 127.0.0.1:32974 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:21:41.553411 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 16214
I20260809 02:21:41.570155 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 16416
I20260809 02:21:41.584828 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 16625
I20260809 02:21:41.592726 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 16065
2026-08-09T02:21:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (797 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:41 dist-test-slave-jlzn krb5kdc[16828](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:41 dist-test-slave-jlzn krb5kdc[16828](info): set up 2 sockets
Aug 09 02:21:41 dist-test-slave-jlzn krb5kdc[16828](info): commencing operation
krb5kdc: starting...
W20260809 02:21:42.709496 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:42 dist-test-slave-jlzn krb5kdc[16828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:21:42.820830 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:40873
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:40873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:42.929183 16851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:42.929407 16851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:42.929457 16851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:42.933290 16851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:42.933336 16851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:42.933362 16851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:42.933383 16851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:42.933411 16851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:42.938349 16851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:40873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:40873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:42.939399 16851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:42.940320 16851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:42.948154 16866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:42.948160 16860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:42.948208 16851 server_base.cc:1034] running on GCE node
W20260809 02:21:42.948154 16868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:42.948932 16851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:42.949893 16851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:42.951050 16851 hybrid_clock.cc:648] HybridClock initialized: now 1786242102951034 us; error 27 us; skew 500 ppm
Aug 09 02:21:42 dist-test-slave-jlzn krb5kdc[16828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242102, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:42.956560 16851 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:21:42.957373 16851 webserver.cc:460] Webserver started at http://127.1.81.254:44153/ using document root <none> and password file <none>
I20260809 02:21:42.957863 16851 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:42.957926 16851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:42.958112 16851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:42.959988 16851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "8f796d6fd1164cdc92f3aa44514ea528"
format_stamp: "Formatted at 2026-08-09 02:21:42 on dist-test-slave-jlzn"
server_key: "d112de5648438e795fbdc219ddb18a9e"
server_key_iv: "92e50c7be70edce429ed5bdcc42ca04b"
server_key_version: "encryptionkey@0"
I20260809 02:21:42.960501 16851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "8f796d6fd1164cdc92f3aa44514ea528"
format_stamp: "Formatted at 2026-08-09 02:21:42 on dist-test-slave-jlzn"
server_key: "d112de5648438e795fbdc219ddb18a9e"
server_key_iv: "92e50c7be70edce429ed5bdcc42ca04b"
server_key_version: "encryptionkey@0"
I20260809 02:21:42.963737 16851 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:42.965867 16877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:42.966918 16851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:42.967026 16851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "8f796d6fd1164cdc92f3aa44514ea528"
format_stamp: "Formatted at 2026-08-09 02:21:42 on dist-test-slave-jlzn"
server_key: "d112de5648438e795fbdc219ddb18a9e"
server_key_iv: "92e50c7be70edce429ed5bdcc42ca04b"
server_key_version: "encryptionkey@0"
I20260809 02:21:42.967113 16851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:42.981865 16851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:42.984182 16851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:42.984334 16851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:42.990855 16851 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:40873
I20260809 02:21:42.991110 16967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:40873 every 8 connection(s)
I20260809 02:21:42.991720 16851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:42.994200 16970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:42.995730 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 16851
I20260809 02:21:42.995865 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:21:42.996119 1351 external_mini_cluster.cc:1428] Setting key fb38f47c6269a4537597e833f79ba0b4
I20260809 02:21:43.000425 16970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528: Bootstrap starting.
I20260809 02:21:43.002846 16970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:43.003679 16970 log.cc:824] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:21:43 dist-test-slave-jlzn krb5kdc[16828](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:43.005789 16970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528: No bootstrap required, opened a new log
I20260809 02:21:43.008898 16970 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f796d6fd1164cdc92f3aa44514ea528" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40873 } }
I20260809 02:21:43.009168 16970 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:43.009236 16970 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f796d6fd1164cdc92f3aa44514ea528, State: Initialized, Role: FOLLOWER
I20260809 02:21:43.009701 16970 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f796d6fd1164cdc92f3aa44514ea528" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40873 } }
I20260809 02:21:43.009830 16970 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:43.009903 16970 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:43.010001 16970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:43.010475 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:42.997371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35448 (local address 127.1.81.254:40873)
0809 02:21:42.997773 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:42.997792 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:42.997832 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:21:42.998578 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:42.998602 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:42.998988 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:42.999335 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:42.999993 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.001403 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.002229 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.002884 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.003039 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.005649 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:43.005654 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:43.005666 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:43.005690 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:43.007621 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.008172 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.008176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.008180 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.008286 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.008549 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.008551 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.008552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.008886 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:43.009038 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.009391 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.009664 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":99,"threads_started":1}
I20260809 02:21:43.010839 16970 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f796d6fd1164cdc92f3aa44514ea528" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40873 } }
I20260809 02:21:43.011153 16970 leader_election.cc:302] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f796d6fd1164cdc92f3aa44514ea528; no voters:
I20260809 02:21:43.011452 16970 leader_election.cc:288] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:43.011507 16978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:43.011747 16978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [term 1 LEADER]: Becoming Leader. State: Replica: 8f796d6fd1164cdc92f3aa44514ea528, State: Running, Role: LEADER
I20260809 02:21:43.012049 16978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f796d6fd1164cdc92f3aa44514ea528" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40873 } }
I20260809 02:21:43.012717 16970 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:43.013756 16984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f796d6fd1164cdc92f3aa44514ea528. Latest consensus state: current_term: 1 leader_uuid: "8f796d6fd1164cdc92f3aa44514ea528" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f796d6fd1164cdc92f3aa44514ea528" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40873 } } }
I20260809 02:21:43.013881 16984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:43.014156 16985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f796d6fd1164cdc92f3aa44514ea528" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f796d6fd1164cdc92f3aa44514ea528" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 40873 } } }
I20260809 02:21:43.014250 16985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:43.014287 16999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:43.016844 16999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:43.021713 16999 catalog_manager.cc:1347] Generated new cluster ID: 7090b173c204405ba565d9e937939ba2
I20260809 02:21:43.021776 16999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:43.038502 16999 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:43.039629 16999 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:43.048660 16999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528: Generated new TSK 0
I20260809 02:21:43.049222 16999 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:21:43.082743 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:40873
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:43.220503 17017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:43.220752 17017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:43.220794 17017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:43.224584 17017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:43.224624 17017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:43.224681 17017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:21:43.229592 17017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:40873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:43.230451 17017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:43.231355 17017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:43.240337 17030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.240353 17031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.240374 17033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:43.240592 17017 server_base.cc:1034] running on GCE node
I20260809 02:21:43.240958 17017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:43.241536 17017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:43.242684 17017 hybrid_clock.cc:648] HybridClock initialized: now 1786242103242668 us; error 29 us; skew 500 ppm
Aug 09 02:21:43 dist-test-slave-jlzn krb5kdc[16828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:43.245296 17017 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:21:43.246076 17017 webserver.cc:460] Webserver started at http://127.1.81.193:42561/ using document root <none> and password file <none>
I20260809 02:21:43.246575 17017 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:43.246635 17017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:43.246821 17017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:43.248766 17017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "82a306adb1424037995425f8a9e34274"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "0d93df26f87c93f718df89ff3248223b"
server_key_iv: "e756a92776f5e4a2f7a2eef107b6d908"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.249293 17017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "82a306adb1424037995425f8a9e34274"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "0d93df26f87c93f718df89ff3248223b"
server_key_iv: "e756a92776f5e4a2f7a2eef107b6d908"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.252743 17017 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:43.254879 17043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.256002 17017 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:43.256107 17017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "82a306adb1424037995425f8a9e34274"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "0d93df26f87c93f718df89ff3248223b"
server_key_iv: "e756a92776f5e4a2f7a2eef107b6d908"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.256203 17017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:43.271131 17017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:43.273983 17017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:43.274151 17017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:43.274678 17017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:43.275432 17017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:43.275478 17017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.275527 17017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:43.275553 17017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.283717 17017 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:38007
I20260809 02:21:43.283757 17243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:38007 every 8 connection(s)
I20260809 02:21:43.284524 17017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:43.289023 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 17017
I20260809 02:21:43.289114 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:43.289374 1351 external_mini_cluster.cc:1428] Setting key 27b9f50cd256b9dd32f5a3d518620811
Aug 09 02:21:43 dist-test-slave-jlzn krb5kdc[16828](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:43.297600 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.286132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:50617 (local address 127.1.81.254:40873)
0809 02:21:43.286260 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.286264 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.286978 (+ 714us) server_negotiation.cc:407] Connection header received
0809 02:21:43.288287 (+ 1309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.288290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.288337 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.288407 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:43.289447 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.290093 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.291294 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.291523 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.291624 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.294197 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:43.294201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:43.294204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:43.294237 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:43.295570 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.296113 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.296118 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.296120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.296219 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.296520 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.296523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.296525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.296749 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:43.296844 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.297388 (+ 544us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.297484 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:21:43.298688 17248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.286435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:40873 (local address 127.1.81.193:50617)
0809 02:21:43.286839 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:43.286877 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:43.288101 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:43.288526 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:43.288532 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:43.288842 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:43.289307 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.289322 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.290219 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.290222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.291179 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.291190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.291672 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.291677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.291864 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.292339 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:43.292355 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:43.294026 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:43.295688 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:43.295693 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:43.295704 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:43.296010 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:43.296304 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:43.296306 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:43.296308 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:43.296431 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:43.296841 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:43.296846 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:43.297133 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 02:21:43.297342 (+ 209us) client_negotiation.cc:240] Negotiation successful
0809 02:21:43.297651 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":112,"threads_started":1}
I20260809 02:21:43.299850 17245 heartbeater.cc:347] Connected to a master server at 127.1.81.254:40873
I20260809 02:21:43.300052 17245 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:43.300467 17245 heartbeater.cc:511] Master 127.1.81.254:40873 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:21:43.301806 16904 ts_manager.cc:194] Registered new tserver with Master: 82a306adb1424037995425f8a9e34274 (127.1.81.193:38007)
I20260809 02:21:43.302870 16904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:50617
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:21:43.316442 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:40873
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:43.424846 17254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:43.425064 17254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:43.425102 17254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:43.428938 17254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:43.428984 17254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:43.429035 17254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:21:43.433954 17254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:40873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:43.434780 17254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:43.435635 17254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:43.444519 17263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.444537 17264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.444509 17269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:43.444731 17254 server_base.cc:1034] running on GCE node
I20260809 02:21:43.445228 17254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:43.445779 17254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:43.446935 17254 hybrid_clock.cc:648] HybridClock initialized: now 1786242103446922 us; error 23 us; skew 500 ppm
Aug 09 02:21:43 dist-test-slave-jlzn krb5kdc[16828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:43.449497 17254 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:21:43.450253 17254 webserver.cc:460] Webserver started at http://127.1.81.194:39113/ using document root <none> and password file <none>
I20260809 02:21:43.450742 17254 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:43.450806 17254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:43.450997 17254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:43.452975 17254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "f06d25adfd8d4dc1b70ff46ad3097a08"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "2fe4600c08b5e2dc441e7c5cb416db07"
server_key_iv: "7a3e04285740dbc44b4f165e10d3f824"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.453501 17254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "f06d25adfd8d4dc1b70ff46ad3097a08"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "2fe4600c08b5e2dc441e7c5cb416db07"
server_key_iv: "7a3e04285740dbc44b4f165e10d3f824"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.456818 17254 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:21:43.458930 17280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.460117 17254 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:43.460223 17254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "f06d25adfd8d4dc1b70ff46ad3097a08"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "2fe4600c08b5e2dc441e7c5cb416db07"
server_key_iv: "7a3e04285740dbc44b4f165e10d3f824"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.460309 17254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:43.484553 17254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:43.486981 17254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:43.487145 17254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:43.487650 17254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:43.488409 17254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:43.488466 17254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.488517 17254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:43.488541 17254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.496748 17254 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:40303
I20260809 02:21:43.496775 17457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:40303 every 8 connection(s)
I20260809 02:21:43.497524 17254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:43.501780 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 17254
I20260809 02:21:43.501879 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:43.502126 1351 external_mini_cluster.cc:1428] Setting key 05ce4a26229fc8f66e3456769e3cf12d
Aug 09 02:21:43 dist-test-slave-jlzn krb5kdc[16828](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:43.510311 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.499084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:41643 (local address 127.1.81.254:40873)
0809 02:21:43.499221 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.499226 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.499999 (+ 773us) server_negotiation.cc:407] Connection header received
0809 02:21:43.501241 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.501244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.501291 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.501360 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:43.502477 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.503073 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.504265 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.504590 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.504694 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.507089 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:43.507092 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:43.507094 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:43.507118 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:43.508445 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.508919 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.508922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.508923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.509003 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.509308 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.509312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.509313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.509481 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:43.509565 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.510024 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.510154 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:21:43.510974 17460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.499437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:40873 (local address 127.1.81.194:41643)
0809 02:21:43.499872 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:43.499912 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:43.501055 (+ 1143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:43.501498 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:43.501504 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:43.501829 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:43.502332 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.502348 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.503236 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.503240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.504146 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.504159 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.504730 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.504733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.504867 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.505413 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:43.505434 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:43.506941 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:43.508550 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:43.508555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:43.508569 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:43.508825 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:43.509085 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:43.509088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:43.509090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:43.509221 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:43.509582 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:43.509588 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:43.509808 (+ 220us) client_negotiation.cc:769] Sending connection context
0809 02:21:43.509962 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 02:21:43.510245 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
I20260809 02:21:43.512023 17458 heartbeater.cc:347] Connected to a master server at 127.1.81.254:40873
I20260809 02:21:43.512259 17458 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:43.512727 17458 heartbeater.cc:511] Master 127.1.81.254:40873 requested a full tablet report, sending...
I20260809 02:21:43.513721 16904 ts_manager.cc:194] Registered new tserver with Master: f06d25adfd8d4dc1b70ff46ad3097a08 (127.1.81.194:40303)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
I20260809 02:21:43.514429 16904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:41643
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:21:43.527701 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:40873
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:43.635671 17465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:43.635932 17465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:43.635985 17465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:43.639830 17465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:43.639885 17465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:43.639954 17465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:21:43.644943 17465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:40873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:21:43.645817 17465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:43.646775 17465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:43.655663 17479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.655741 17474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.655841 17476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:43.655956 17465 server_base.cc:1034] running on GCE node
I20260809 02:21:43.656445 17465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:43.657013 17465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:43.658169 17465 hybrid_clock.cc:648] HybridClock initialized: now 1786242103658154 us; error 27 us; skew 500 ppm
Aug 09 02:21:43 dist-test-slave-jlzn krb5kdc[16828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:43.660848 17465 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:21:43.661592 17465 webserver.cc:460] Webserver started at http://127.1.81.195:44065/ using document root <none> and password file <none>
I20260809 02:21:43.662119 17465 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:43.662197 17465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:43.662437 17465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:43.664512 17465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "bfcf4939f2d94e90b132f2f48865f1f2"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "60f9d072cfb6400af20681600f03b52b"
server_key_iv: "2f90ec7a7b63ca4e9217766a83436218"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.665042 17465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "bfcf4939f2d94e90b132f2f48865f1f2"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "60f9d072cfb6400af20681600f03b52b"
server_key_iv: "2f90ec7a7b63ca4e9217766a83436218"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.668406 17465 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 02:21:43.670550 17488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.671662 17465 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:43.671764 17465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "bfcf4939f2d94e90b132f2f48865f1f2"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-jlzn"
server_key: "60f9d072cfb6400af20681600f03b52b"
server_key_iv: "2f90ec7a7b63ca4e9217766a83436218"
server_key_version: "encryptionkey@0"
I20260809 02:21:43.671886 17465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:43.690563 17465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:43.693051 17465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:43.693205 17465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:43.693711 17465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:43.694442 17465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:43.694489 17465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.694538 17465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:43.694566 17465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.702713 17465 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:42023
I20260809 02:21:43.702740 17668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:42023 every 8 connection(s)
I20260809 02:21:43.703519 17465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:21:43 dist-test-slave-jlzn krb5kdc[16828](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:21:43.713279 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 17465
I20260809 02:21:43.713402 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:43.713733 1351 external_mini_cluster.cc:1428] Setting key 4ad3fa58e59c6a20d82cab4a25299f01
I20260809 02:21:43.716892 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.705273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:56463 (local address 127.1.81.254:40873)
0809 02:21:43.705415 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.705419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.706136 (+ 717us) server_negotiation.cc:407] Connection header received
0809 02:21:43.707378 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.707381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.707427 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.707495 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:43.708571 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.709080 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.710133 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.710339 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.710404 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.712903 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:43.712907 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:43.712910 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:43.712940 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:43.714601 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.715287 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.715291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.715293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.715411 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.715730 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.715733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.715741 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.715994 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:43.716094 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.716604 (+ 510us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.716731 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:21:43.717562 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.705566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:40873 (local address 127.1.81.195:56463)
0809 02:21:43.705991 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:43.706031 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:43.707206 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:43.707652 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:43.707658 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:43.708017 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:43.708456 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.708469 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.709175 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.709178 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.710045 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.710055 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.710438 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.710441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.710619 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.711159 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:43.711175 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:43.712735 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:43.714748 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:43.714763 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:43.714776 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:43.715135 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:43.715499 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:43.715501 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:43.715503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:43.715642 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:43.716106 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:43.716113 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:43.716369 (+ 256us) client_negotiation.cc:769] Sending connection context
0809 02:21:43.716529 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 02:21:43.716823 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":113,"threads_started":1}
I20260809 02:21:43.718537 17669 heartbeater.cc:347] Connected to a master server at 127.1.81.254:40873
I20260809 02:21:43.718730 17669 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:43.719134 17669 heartbeater.cc:511] Master 127.1.81.254:40873 requested a full tablet report, sending...
I20260809 02:21:43.720078 16904 ts_manager.cc:194] Registered new tserver with Master: bfcf4939f2d94e90b132f2f48865f1f2 (127.1.81.195:42023)
I20260809 02:21:43.720628 16904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:56463
I20260809 02:21:43.727603 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:21:43.735548 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.729409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35464 (local address 127.1.81.254:40873)
0809 02:21:43.729540 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.729545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.729705 (+ 160us) server_negotiation.cc:407] Connection header received
0809 02:21:43.729793 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.729796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.729832 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.729892 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:43.730506 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.730987 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.731776 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.731983 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.732047 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.733171 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:43.733175 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:43.733176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:43.733198 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:43.734275 (+ 1077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.734642 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.734645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.734646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.734718 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.734895 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.734896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.734897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.735082 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:43.735178 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.735324 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.735408 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:21:43.738029 16904 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35464:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:43.740942 16904 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:43.754544 17686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.749215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:38007 (local address 127.0.0.1:33144)
0809 02:21:43.749696 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:43.749709 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:43.749792 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:43.750543 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:43.750546 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:43.750563 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:43.750660 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.750667 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.751622 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.751625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.753199 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.753212 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.754045 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.754049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.754154 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.754192 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 02:21:43.754290 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 02:21:43.754408 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":191,"thread_start_us":91,"threads_started":1}
I20260809 02:21:43.754585 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.749664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33144 (local address 127.1.81.193:38007)
0809 02:21:43.750116 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.750141 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.750164 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:21:43.750239 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.750244 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.750406 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.750542 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:43.750772 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.751481 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.753347 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.753921 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.754023 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.754169 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.754344 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.754442 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":120,"threads_started":1}
I20260809 02:21:43.754908 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.748965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:42023 (local address 127.0.0.1:50274)
0809 02:21:43.749464 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:43.749477 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:43.749560 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:43.750240 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:43.750246 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:43.750268 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:43.750380 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.750386 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.751855 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.751859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.753080 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.753090 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.754329 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.754333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.754583 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.754604 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:21:43.754676 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:21:43.754733 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":88,"thread_start_us":105,"threads_started":1}
I20260809 02:21:43.755065 17689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.749347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50274 (local address 127.1.81.195:42023)
0809 02:21:43.749791 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.749802 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.749823 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:21:43.749893 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.749898 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.750088 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.750231 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:43.750502 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.751686 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.753208 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.754017 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.754123 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.754262 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.754837 (+ 575us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.754932 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":82,"threads_started":1}
I20260809 02:21:43.754765 17684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.748543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40303 (local address 127.0.0.1:56696)
0809 02:21:43.748849 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:43.748900 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:43.749014 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:43.750390 (+ 1376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:43.750392 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:43.750408 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:43.750491 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.750497 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.751890 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.751894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.753236 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.753244 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.754351 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.754354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.754471 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.754496 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:21:43.754563 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:21:43.754629 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":184,"thread_start_us":76,"threads_started":1}
I20260809 02:21:43.756045 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.748723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56696 (local address 127.1.81.194:40303)
0809 02:21:43.749156 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.749168 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.749192 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:21:43.749911 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.749918 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.750112 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.750275 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:43.750614 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.751722 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.753345 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.754088 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.754188 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.754301 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.754866 (+ 565us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.755902 (+ 1036us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":113,"threads_started":1}
I20260809 02:21:43.757767 17129 tablet_service.cc:1467] Processing CreateTablet for tablet a688bf96d79e446384cae88703006394 (DEFAULT_TABLE table=test-table [id=0064b2212bac4907aec41059d285264e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:43.757841 17564 tablet_service.cc:1467] Processing CreateTablet for tablet a688bf96d79e446384cae88703006394 (DEFAULT_TABLE table=test-table [id=0064b2212bac4907aec41059d285264e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:43.758708 17129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a688bf96d79e446384cae88703006394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:43.758512 17345 tablet_service.cc:1467] Processing CreateTablet for tablet a688bf96d79e446384cae88703006394 (DEFAULT_TABLE table=test-table [id=0064b2212bac4907aec41059d285264e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:43.758893 17564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a688bf96d79e446384cae88703006394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:43.759491 17345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a688bf96d79e446384cae88703006394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:43.764588 17695 tablet_bootstrap.cc:492] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274: Bootstrap starting.
I20260809 02:21:43.766085 17696 tablet_bootstrap.cc:492] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Bootstrap starting.
I20260809 02:21:43.767392 17695 tablet_bootstrap.cc:654] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:43.768093 17697 tablet_bootstrap.cc:492] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Bootstrap starting.
I20260809 02:21:43.768841 17695 log.cc:824] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:43.769008 17696 tablet_bootstrap.cc:654] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:43.769783 17696 log.cc:824] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:43.770653 17697 tablet_bootstrap.cc:654] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:43.770941 17695 tablet_bootstrap.cc:492] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274: No bootstrap required, opened a new log
I20260809 02:21:43.771138 17695 ts_tablet_manager.cc:1397] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260809 02:21:43.771474 17697 log.cc:824] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:43.771730 17696 tablet_bootstrap.cc:492] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: No bootstrap required, opened a new log
I20260809 02:21:43.771934 17696 ts_tablet_manager.cc:1397] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:21:43.775149 17695 raft_consensus.cc:348] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.775411 17695 raft_consensus.cc:374] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:43.775466 17695 raft_consensus.cc:729] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a306adb1424037995425f8a9e34274, State: Initialized, Role: FOLLOWER
I20260809 02:21:43.775622 17696 raft_consensus.cc:348] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.775875 17696 raft_consensus.cc:374] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:43.775933 17696 raft_consensus.cc:729] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f06d25adfd8d4dc1b70ff46ad3097a08, State: Initialized, Role: FOLLOWER
I20260809 02:21:43.775913 17695 consensus_queue.cc:260] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.776098 17697 tablet_bootstrap.cc:492] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: No bootstrap required, opened a new log
I20260809 02:21:43.776286 17697 ts_tablet_manager.cc:1397] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s
I20260809 02:21:43.776394 17696 consensus_queue.cc:260] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.776783 17245 heartbeater.cc:503] Master 127.1.81.254:40873 was elected leader, sending a full tablet report...
I20260809 02:21:43.776890 17695 ts_tablet_manager.cc:1428] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260809 02:21:43.777245 17696 ts_tablet_manager.cc:1428] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:21:43.777536 17458 heartbeater.cc:503] Master 127.1.81.254:40873 was elected leader, sending a full tablet report...
I20260809 02:21:43.779767 17697 raft_consensus.cc:348] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.780012 17697 raft_consensus.cc:374] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:43.780082 17697 raft_consensus.cc:729] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfcf4939f2d94e90b132f2f48865f1f2, State: Initialized, Role: FOLLOWER
I20260809 02:21:43.780483 17697 consensus_queue.cc:260] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.781075 17669 heartbeater.cc:503] Master 127.1.81.254:40873 was elected leader, sending a full tablet report...
I20260809 02:21:43.781380 17697 ts_tablet_manager.cc:1428] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
W20260809 02:21:43.785522 17247 tablet.cc:2369] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:21:43.954483 17670 tablet.cc:2369] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:43.976007 17702 raft_consensus.cc:482] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:43.976222 17702 raft_consensus.cc:504] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.977345 17702 leader_election.cc:288] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a306adb1424037995425f8a9e34274 (127.1.81.193:38007), bfcf4939f2d94e90b132f2f48865f1f2 (127.1.81.195:42023)
I20260809 02:21:43.981009 17460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.977556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:38007 (local address 127.1.81.194:45077)
0809 02:21:43.977766 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:43.977780 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:43.977864 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:43.978108 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:43.978110 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:43.978127 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:43.978261 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.978269 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.979031 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.979034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.979940 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.979951 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.980600 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.980603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.980721 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.980744 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:21:43.980814 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:21:43.980871 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":19}
I20260809 02:21:43.981050 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.977656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:45077 (local address 127.1.81.193:38007)
0809 02:21:43.977792 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.977796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.977835 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:21:43.977956 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.977959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.978020 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.978093 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:43.978365 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.978924 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.980061 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.980485 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.980578 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.980618 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.980844 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.980922 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:21:43.981098 17689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.977709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:53945 (local address 127.1.81.195:42023)
0809 02:21:43.977822 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.977828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.978052 (+ 224us) server_negotiation.cc:407] Connection header received
0809 02:21:43.978176 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.978179 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.978230 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.978303 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:43.978556 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.979063 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.980188 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.980606 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.980716 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.980763 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.980930 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.980994 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:21:43.981153 17705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.977579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:42023 (local address 127.1.81.194:53945)
0809 02:21:43.977962 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:43.977974 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:43.978078 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:43.978330 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:43.978333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:43.978351 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:43.978465 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.978471 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.979172 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.979174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.980064 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:43.980074 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.980723 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.980725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:43.980809 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.980833 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:21:43.980905 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:21:43.980970 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":31,"thread_start_us":80,"threads_started":1}
I20260809 02:21:43.981590 17159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a688bf96d79e446384cae88703006394" candidate_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a306adb1424037995425f8a9e34274" is_pre_election: true
I20260809 02:21:43.981894 17159 raft_consensus.cc:2454] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f06d25adfd8d4dc1b70ff46ad3097a08 in term 0.
I20260809 02:21:43.981927 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a688bf96d79e446384cae88703006394" candidate_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" is_pre_election: true
I20260809 02:21:43.982201 17604 raft_consensus.cc:2454] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f06d25adfd8d4dc1b70ff46ad3097a08 in term 0.
I20260809 02:21:43.982393 17291 leader_election.cc:302] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a306adb1424037995425f8a9e34274, f06d25adfd8d4dc1b70ff46ad3097a08; no voters:
I20260809 02:21:43.982654 17702 raft_consensus.cc:2781] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:43.982734 17702 raft_consensus.cc:482] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:43.982764 17702 raft_consensus.cc:3037] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:43.983939 17702 raft_consensus.cc:504] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.984249 17702 leader_election.cc:288] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [CANDIDATE]: Term 1 election: Requested vote from peers 82a306adb1424037995425f8a9e34274 (127.1.81.193:38007), bfcf4939f2d94e90b132f2f48865f1f2 (127.1.81.195:42023)
I20260809 02:21:43.984567 17159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a688bf96d79e446384cae88703006394" candidate_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a306adb1424037995425f8a9e34274"
I20260809 02:21:43.984596 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a688bf96d79e446384cae88703006394" candidate_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfcf4939f2d94e90b132f2f48865f1f2"
I20260809 02:21:43.984696 17604 raft_consensus.cc:3037] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:43.984696 17159 raft_consensus.cc:3037] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:43.985896 17159 raft_consensus.cc:2454] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f06d25adfd8d4dc1b70ff46ad3097a08 in term 1.
I20260809 02:21:43.985896 17604 raft_consensus.cc:2454] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f06d25adfd8d4dc1b70ff46ad3097a08 in term 1.
I20260809 02:21:43.986163 17281 leader_election.cc:302] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfcf4939f2d94e90b132f2f48865f1f2, f06d25adfd8d4dc1b70ff46ad3097a08; no voters:
I20260809 02:21:43.986316 17702 raft_consensus.cc:2781] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:43.986529 17702 raft_consensus.cc:686] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 1 LEADER]: Becoming Leader. State: Replica: f06d25adfd8d4dc1b70ff46ad3097a08, State: Running, Role: LEADER
I20260809 02:21:43.986825 17702 consensus_queue.cc:237] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } }
I20260809 02:21:43.989562 16904 catalog_manager.cc:5495] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 reported cstate change: term changed from 0 to 1, leader changed from <none> to f06d25adfd8d4dc1b70ff46ad3097a08 (127.1.81.194). New cstate: current_term: 1 leader_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06d25adfd8d4dc1b70ff46ad3097a08" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 } health_report { overall_health: UNKNOWN } } }
W20260809 02:21:43.998520 17459 tablet.cc:2369] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:44.048363 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:44.044849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56698 (local address 127.1.81.194:40303)
0809 02:21:44.044973 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:44.044977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:44.044992 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:21:44.045131 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:44.045134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:44.045201 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:44.045291 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:44.045536 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.046026 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.046893 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.047124 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.047215 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:44.047520 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:44.047967 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:44.048073 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:44.048146 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 02:21:44.048204 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:21:44.054080 17159 raft_consensus.cc:1261] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 1 FOLLOWER]: Refusing update from remote peer f06d25adfd8d4dc1b70ff46ad3097a08: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:44.054080 17604 raft_consensus.cc:1261] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 1 FOLLOWER]: Refusing update from remote peer f06d25adfd8d4dc1b70ff46ad3097a08: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:44.054847 17702 consensus_queue.cc:1035] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a306adb1424037995425f8a9e34274" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 38007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:44.055050 17706 consensus_queue.cc:1035] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfcf4939f2d94e90b132f2f48865f1f2" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:44.061620 17709 mvcc.cc:205] Tried to move back new op lower bound from 7316447658197864448 to 7316447657932632064. Current Snapshot: MvccSnapshot[applied={T|T < 7316447658197864448}]
I20260809 02:21:44.061853 17711 mvcc.cc:205] Tried to move back new op lower bound from 7316447658197864448 to 7316447657932632064. Current Snapshot: MvccSnapshot[applied={T|T < 7316447658197864448}]
I20260809 02:21:44.063410 17712 mvcc.cc:205] Tried to move back new op lower bound from 7316447658197864448 to 7316447657932632064. Current Snapshot: MvccSnapshot[applied={T|T < 7316447658197864448}]
I20260809 02:21:44.070760 16904 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:44.070894 16904 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:44.073153 16904 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8f796d6fd1164cdc92f3aa44514ea528: Sending DeleteTablet for 3 replicas of tablet a688bf96d79e446384cae88703006394
I20260809 02:21:44.073863 17129 tablet_service.cc:1514] Processing DeleteTablet for tablet a688bf96d79e446384cae88703006394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:44 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:33144
I20260809 02:21:44.073863 17345 tablet_service.cc:1514] Processing DeleteTablet for tablet a688bf96d79e446384cae88703006394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:44 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:56696
I20260809 02:21:44.074384 17729 tablet_replica.cc:330] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274: stopping tablet replica
I20260809 02:21:44.074335 17564 tablet_service.cc:1514] Processing DeleteTablet for tablet a688bf96d79e446384cae88703006394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:44 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:50274
I20260809 02:21:44.074689 17729 raft_consensus.cc:2229] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:44.074891 17732 tablet_replica.cc:330] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: stopping tablet replica
I20260809 02:21:44.075019 17729 raft_consensus.cc:2258] T a688bf96d79e446384cae88703006394 P 82a306adb1424037995425f8a9e34274 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:44.075276 17732 raft_consensus.cc:2229] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:44.075304 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 17017
I20260809 02:21:44.075613 17732 raft_consensus.cc:2258] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:44.076951 17732 ts_tablet_manager.cc:1905] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:44.079560 17732 ts_tablet_manager.cc:1918] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:44.079661 17732 log.cc:1196] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/a688bf96d79e446384cae88703006394
I20260809 02:21:44.080040 17732 ts_tablet_manager.cc:1939] T a688bf96d79e446384cae88703006394 P bfcf4939f2d94e90b132f2f48865f1f2: Deleting consensus metadata
I20260809 02:21:44.084019 16879 catalog_manager.cc:4841] TS bfcf4939f2d94e90b132f2f48865f1f2 (127.1.81.195:42023): tablet a688bf96d79e446384cae88703006394 (table test-table [id=0064b2212bac4907aec41059d285264e]) successfully deleted
I20260809 02:21:44.084074 17727 tablet_replica.cc:330] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: stopping tablet replica
I20260809 02:21:44.084334 17727 raft_consensus.cc:2229] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:44.084694 17727 raft_consensus.cc:2258] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:44.085871 17727 ts_tablet_manager.cc:1905] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:44.088436 17727 ts_tablet_manager.cc:1918] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:44.088529 17727 log.cc:1196] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/a688bf96d79e446384cae88703006394
I20260809 02:21:44.088835 17727 ts_tablet_manager.cc:1939] T a688bf96d79e446384cae88703006394 P f06d25adfd8d4dc1b70ff46ad3097a08: Deleting consensus metadata
I20260809 02:21:44.089875 16882 catalog_manager.cc:4841] TS f06d25adfd8d4dc1b70ff46ad3097a08 (127.1.81.194:40303): tablet a688bf96d79e446384cae88703006394 (table test-table [id=0064b2212bac4907aec41059d285264e]) successfully deleted
W20260809 02:21:44.090364 16882 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:38007 (error 108)
I20260809 02:21:44.091110 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 17254
I20260809 02:21:44.091336 17684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:44.091045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:38007 (local address 127.0.0.1:33150)
0809 02:21:44.091185 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:44.091256 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:38007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 02:21:44.095350 16882 catalog_manager.cc:4584] TS 82a306adb1424037995425f8a9e34274 (127.1.81.193:38007): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a688bf96d79e446384cae88703006394: Network error: Client connection negotiation failed: client connection to 127.1.81.193:38007: connect: Connection refused (error 111)
I20260809 02:21:44.103073 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 17465
I20260809 02:21:44.118610 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 16851
2026-08-09T02:21:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2524 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:44 dist-test-slave-jlzn krb5kdc[17738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:44 dist-test-slave-jlzn krb5kdc[17738](info): set up 2 sockets
Aug 09 02:21:44 dist-test-slave-jlzn krb5kdc[17738](info): commencing operation
krb5kdc: starting...
W20260809 02:21:45.267573 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:21:45 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:45Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.81.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.81.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/rangeradmin_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/rangeradmin_127.1.81.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.81.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.81.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/rangerlookup_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/rangerlookup_127.1.81.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.81.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.81.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/HTTP_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/HTTP_127.1.81.212@KRBTEST.COM.keytab.
I20260809 02:21:45.414901 1351 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskAskc7b/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/postgres -l logfile start
2026-08-09 02:21:47.596 UTC [17789] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 02:21:47.596 UTC [17789] LOG: listening on IPv4 address "127.1.81.212", port 43131
2026-08-09 02:21:47.599 UTC [17789] LOG: listening on Unix socket "/tmp/.s.PGSQL.43131"
2026-08-09 02:21:47.619 UTC [17793] LOG: database system was shut down at 2026-08-09 02:21:46 UTC
2026-08-09 02:21:47.623 UTC [17789] LOG: database system is ready to accept connections
I20260809 02:21:48.679430 1351 mini_postgres.cc:96] Postgres bound to 43131
2026-08-09 02:21:48.687 UTC [17807] FATAL: database "slave" does not exist
127.1.81.212:43131 - accepting connections
I20260809 02:21:48.688325 1351 mini_ranger.cc:161] Starting Ranger...
I20260809 02:21:48.703591 1351 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 02:21:49.087746 1351 mini_ranger.cc:87] Created ranger Postgres database
I20260809 02:21:49.087849 1351 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-admin
2026-08-09 02:21:49,384 [I] DB FLAVOR :POSTGRES
2026-08-09 02:21:49,384 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:21:49,385 [I] Checking connection..
2026-08-09 02:21:49,385 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 02:21:49,624 [I] Checking connection passed.
2026-08-09 02:21:49,624 [I] --------- Verifying version history table ---------
2026-08-09 02:21:49,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:21:49,861 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:21:49,862 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:21:50,115 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:21:50,115 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 02:21:50,115 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 02:21:50.346 UTC [17911] WARNING: there is no transaction in progress
2026-08-09 02:21:50,354 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 02:21:50,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:21:50,592 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 02:21:50,592 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:21:50,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 02:21:50,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 02:21:51,087 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jlzn.c.gcp-upstream.internal','N') ;"
2026-08-09 02:21:51,316 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:21:51,552 [I] Table x_portal_user does not exist in database ranger
2026-08-09 02:21:51,553 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:21:51,792 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 02:21:51,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:21:52,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:21:52,295 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 02:21:52,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 02:21:53.169 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.183 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.196 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.209 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.223 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.238 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.285 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.291 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.304 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.313 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.322 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.334 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.342 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.347 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.352 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53.358 UTC [18083] WARNING: there is no transaction in progress
2026-08-09 02:21:53,879 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 02:21:53,879 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 02:21:54,120 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 02:21:54,121 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:21:54,374 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 02:21:54,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:21:54,630 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 02:21:54,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:21:54,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:21:55,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jlzn.c.gcp-upstream.internal';"
2026-08-09 02:21:55,364 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 02:21:55,364 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 02:21:55,618 [I] DB_PATCHES have already been applied
I20260809 02:21:55.623848 1351 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-admin:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskAskc7b/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 02:21:55.623909 1351 mini_ranger.cc:193] Using host: 127.1.81.212
I20260809 02:21:55.628052 1351 mini_ranger.cc:227] Ranger admin URL: http://127.1.81.212:53825
Aug 09, 2026 2:21:55 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:21:55 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:21:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 2:21:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 2:21:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 2:21:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 2:21:56 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 02:21:56.827603 1351 mini_ranger.cc:160] Time spent starting Ranger: real 8.139s user 0.000s sys 0.011s
Aug 09, 2026 2:22:16 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 2:22:16 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 2:22:16 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 2:22:16 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 2:22:17 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 02:22:18.249397 1351 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.81.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.81.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/rangerkms_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/rangerkms_127.1.81.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.81.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.81.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.81.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/HTTP_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.81.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/HTTP_127.1.81.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 02:22:18 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242138, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 02:22:18.350005 1351 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 02:22:18.360908 1351 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 02:22:19.052937 1351 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 02:22:19.053040 1351 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms
I20260809 02:22:19.053138 1351 mini_ranger_kms.cc:227] Using postgres at 127.1.81.212:43131
2026-08-09 02:22:19,346 [I] DB FLAVOR :POSTGRES
2026-08-09 02:22:19,346 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:22:19,346 [I] Checking connection
2026-08-09 02:22:19,346 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 02:22:19,622 [I] connection success
2026-08-09 02:22:19,622 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 02:22:19,623 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 02:22:19,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 02:22:19,847 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 02:22:19,847 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:22:19,847 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 02:22:19,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:43131/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 02:22:20,098 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 02:22:20.519553 1351 mini_ranger_kms.cc:310] Created kms service
I20260809 02:22:20.682098 1351 mini_ranger_kms.cc:326] Created kudu user
I20260809 02:22:20.720085 1351 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 02:22:20 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242138, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:22:21.099571 1351 mini_ranger_kms.cc:384] Added ranger policy
I20260809 02:22:21.099735 1351 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms:/tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 02:22:21.099763 1351 mini_ranger_kms.cc:240] Using host: 127.1.81.212
I20260809 02:22:21.104429 1351 mini_ranger_kms.cc:276] Ranger KMS PID: 18349
I20260809 02:22:21.104560 1351 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.81.212:49501
Aug 09, 2026 2:22:22 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:22:22 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:22:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 2:22:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 2:22:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 2:22:22 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 02:22:23 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242143, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.81.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:23.569367 1351 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.219s user 0.013s sys 0.263s
I20260809 02:22:23.569501 1351 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 02:22:23.569615 1351 mini_ranger_kms.cc:401] 127.1.81.212:49501/kms/v1/keys
Aug 09 02:22:23 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242143, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.81.212@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
Aug 09 02:22:24 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242143, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.81.212@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
Aug 09 02:22:26 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:22:26.436918 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:36725
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:36725
--ranger_config_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49501/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:26.583309 18430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:26.583537 18430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:26.583575 18430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:26.587715 18430 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:22:26.587774 18430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:26.587793 18430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:26.587836 18430 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:22:26.587899 18430 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:22:26.593210 18430 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.81.212:49501/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:36725
--ranger_config_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:36725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:22:26.594125 18430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:26.595041 18430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:26.603510 18446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:26.603521 18443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:26.603684 18430 server_base.cc:1034] running on GCE node
W20260809 02:22:26.603821 18444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:26.604476 18430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:26.605748 18430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:26.606930 18430 hybrid_clock.cc:648] HybridClock initialized: now 1786242146606908 us; error 31 us; skew 500 ppm
Aug 09 02:22:26 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242146, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:26.610141 18430 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:22:26.611179 18430 webserver.cc:460] Webserver started at http://127.1.81.254:41313/ using document root <none> and password file <none>
I20260809 02:22:26.611852 18430 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:26.611930 18430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:26.612159 18430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:22:26 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242146, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:22:26.659685 18430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "4db0372b0ff947ea943fa75cd8a1ee12"
format_stamp: "Formatted at 2026-08-09 02:22:26 on dist-test-slave-jlzn"
server_key: "c3f938f709d2ea5726e20a3f4a17d3f7"
server_key_iv: "154305a01ff8e7e4e6a74aeb2173530f"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:26.660578 18430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "4db0372b0ff947ea943fa75cd8a1ee12"
format_stamp: "Formatted at 2026-08-09 02:22:26 on dist-test-slave-jlzn"
server_key: "c3f938f709d2ea5726e20a3f4a17d3f7"
server_key_iv: "154305a01ff8e7e4e6a74aeb2173530f"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:26.665439 18430 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 02:22:26.678593 18455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:26.679981 18430 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:22:26.680104 18430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "4db0372b0ff947ea943fa75cd8a1ee12"
format_stamp: "Formatted at 2026-08-09 02:22:26 on dist-test-slave-jlzn"
server_key: "c3f938f709d2ea5726e20a3f4a17d3f7"
server_key_iv: "154305a01ff8e7e4e6a74aeb2173530f"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:26.680205 18430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:26.712734 18430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:26.715394 18430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:26.715572 18430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:26.722536 18430 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:36725
I20260809 02:22:26.722551 18549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:36725 every 8 connection(s)
I20260809 02:22:26.723397 18430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:22:26.724618 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 18430
I20260809 02:22:26.724735 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:22:26.724987 1351 external_mini_cluster.cc:1428] Setting key e9d312dd23f8c07d0cc82015603df9dd
I20260809 02:22:26.726272 18553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:26.732743 18553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12: Bootstrap starting.
Aug 09 02:22:26 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:22:26.735069 18553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:26.735764 18553 log.cc:824] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:26.737730 18553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12: No bootstrap required, opened a new log
I20260809 02:22:26.739178 18558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:26.726289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57166 (local address 127.1.81.254:36725)
0809 02:22:26.726721 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:26.726745 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:26.726786 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:22:26.727591 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:26.727612 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:26.728021 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:26.728361 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:26.728987 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:26.730423 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:26.731235 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:26.731960 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:26.732108 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:26.734578 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:26.734584 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:26.734595 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:26.734620 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:26.736703 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:26.737152 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:26.737155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:26.737159 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:26.737253 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:26.737526 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:26.737527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:26.737528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:26.737893 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:26.738029 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:26.738308 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 02:22:26.738515 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":123,"threads_started":1}
I20260809 02:22:26.740983 18553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db0372b0ff947ea943fa75cd8a1ee12" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36725 } }
I20260809 02:22:26.741192 18553 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:26.741259 18553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db0372b0ff947ea943fa75cd8a1ee12, State: Initialized, Role: FOLLOWER
I20260809 02:22:26.741614 18553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db0372b0ff947ea943fa75cd8a1ee12" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36725 } }
I20260809 02:22:26.741727 18553 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:22:26.741786 18553 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:22:26.741876 18553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:26.742622 18553 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db0372b0ff947ea943fa75cd8a1ee12" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36725 } }
I20260809 02:22:26.742914 18553 leader_election.cc:302] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4db0372b0ff947ea943fa75cd8a1ee12; no voters:
I20260809 02:22:26.743168 18553 leader_election.cc:288] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:22:26.743257 18561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:22:26.743471 18561 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [term 1 LEADER]: Becoming Leader. State: Replica: 4db0372b0ff947ea943fa75cd8a1ee12, State: Running, Role: LEADER
I20260809 02:22:26.743745 18561 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db0372b0ff947ea943fa75cd8a1ee12" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36725 } }
I20260809 02:22:26.744251 18553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:22:26.745251 18562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4db0372b0ff947ea943fa75cd8a1ee12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db0372b0ff947ea943fa75cd8a1ee12" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36725 } } }
I20260809 02:22:26.745355 18562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [sys.catalog]: This master's current role is: LEADER
I20260809 02:22:26.745645 18563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4db0372b0ff947ea943fa75cd8a1ee12. Latest consensus state: current_term: 1 leader_uuid: "4db0372b0ff947ea943fa75cd8a1ee12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db0372b0ff947ea943fa75cd8a1ee12" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36725 } } }
I20260809 02:22:26.745726 18579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:22:26.745797 18563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12 [sys.catalog]: This master's current role is: LEADER
I20260809 02:22:26.748347 18579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:22:26.748708 18553 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:22:26.758648 18579 catalog_manager.cc:1347] Generated new cluster ID: e0aec9e8c27c4bd197632432ec074c86
I20260809 02:22:26.758720 18579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:22:26.785998 18579 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:22:26.786849 18579 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:22:26.795893 18579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12: Generated new TSK 0
I20260809 02:22:26.796456 18579 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:22:27.550163 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36725
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:27.693087 18632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:27.693323 18632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:27.693364 18632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:27.697283 18632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:27.697336 18632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:27.697410 18632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:22:27.704145 18632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.81.212:49501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:22:27.705453 18632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:27.706528 18632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:27.717880 18644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:27.718083 18632 server_base.cc:1034] running on GCE node
W20260809 02:22:27.718250 18650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:27.718292 18647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:27.718760 18632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:27.719340 18632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:27.720510 18632 hybrid_clock.cc:648] HybridClock initialized: now 1786242147720482 us; error 37 us; skew 500 ppm
Aug 09 02:22:27 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242147, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:27.724112 18632 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:22:27.725055 18632 webserver.cc:460] Webserver started at http://127.1.81.193:33123/ using document root <none> and password file <none>
I20260809 02:22:27.725648 18632 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:27.725711 18632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:27.725888 18632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:22:27 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242147, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:22:27.744613 18632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "58fb34e3c5934abfa2c2c22368dad81d"
format_stamp: "Formatted at 2026-08-09 02:22:27 on dist-test-slave-jlzn"
server_key: "9d4deda41eb8018d3b4ec9bc4df933b4"
server_key_iv: "3f86d7b9a12726d827abedaef5348a78"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:27.745293 18632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "58fb34e3c5934abfa2c2c22368dad81d"
format_stamp: "Formatted at 2026-08-09 02:22:27 on dist-test-slave-jlzn"
server_key: "9d4deda41eb8018d3b4ec9bc4df933b4"
server_key_iv: "3f86d7b9a12726d827abedaef5348a78"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:27.751186 18632 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.000s
I20260809 02:22:27.767846 18661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:27.769464 18632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 02:22:27.769655 18632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "58fb34e3c5934abfa2c2c22368dad81d"
format_stamp: "Formatted at 2026-08-09 02:22:27 on dist-test-slave-jlzn"
server_key: "9d4deda41eb8018d3b4ec9bc4df933b4"
server_key_iv: "3f86d7b9a12726d827abedaef5348a78"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:27.769861 18632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:27.807256 18632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:27.810895 18632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:27.811156 18632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:27.811992 18632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:27.813200 18632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:27.813268 18632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:27.813326 18632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:27.813406 18632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 02:22:27.825825 18632 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:45203
I20260809 02:22:27.827126 18632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:22:27.828882 18838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:45203 every 8 connection(s)
I20260809 02:22:27.832544 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 18632
I20260809 02:22:27.832688 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:22:27.833017 1351 external_mini_cluster.cc:1428] Setting key b767c78e34922ba71164e39667d3199e
Aug 09 02:22:27 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242147, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
I20260809 02:22:27.851516 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:27.830667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:52359 (local address 127.1.81.254:36725)
0809 02:22:27.830918 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:27.830923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:27.835183 (+ 4260us) server_negotiation.cc:407] Connection header received
0809 02:22:27.836701 (+ 1518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:27.836704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:27.836764 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:27.836864 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:27.838277 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:27.839147 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:27.840884 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:27.841242 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:27.841351 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:27.844672 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:27.844677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:27.844680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:27.844710 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:27.846749 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:27.847572 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:27.847576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:27.847578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:27.847677 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:27.848196 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:27.848200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:27.848202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:27.848435 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:27.848524 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:27.851192 (+ 2668us) server_negotiation.cc:299] Negotiation successful
0809 02:22:27.851322 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":80,"threads_started":1}
I20260809 02:22:27.853245 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:27.831094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36725 (local address 127.1.81.193:52359)
0809 02:22:27.832222 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:27.832284 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:27.836376 (+ 4092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:27.837077 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:27.837086 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:27.837437 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:27.838098 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:27.838118 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:27.839308 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:27.839311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:27.840741 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:27.840753 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:27.841528 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:27.841532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:27.841737 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:27.842354 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:27.842374 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:27.844463 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:27.846917 (+ 2454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:27.846929 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:27.847104 (+ 175us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:27.847445 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:27.847781 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:27.847784 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:27.847786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:27.847994 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:27.850605 (+ 2611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:27.850611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:27.850896 (+ 285us) client_negotiation.cc:769] Sending connection context
0809 02:22:27.851946 (+ 1050us) client_negotiation.cc:240] Negotiation successful
0809 02:22:27.852254 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"thread_start_us":122,"threads_started":1}
I20260809 02:22:27.854552 18839 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36725
I20260809 02:22:27.854808 18839 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:27.855377 18839 heartbeater.cc:511] Master 127.1.81.254:36725 requested a full tablet report, sending...
I20260809 02:22:27.857120 18489 ts_manager.cc:194] Registered new tserver with Master: 58fb34e3c5934abfa2c2c22368dad81d (127.1.81.193:45203)
I20260809 02:22:27.858603 18489 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:52359
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:22:27.872402 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36725
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:22:27 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242147, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 02:22:28.050012 18848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:28.050355 18848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:28.050420 18848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:28.054842 18848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:28.054900 18848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:28.054957 18848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:22:28.060070 18848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.81.212:49501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:22:28.060987 18848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:28.061954 18848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:28.072677 18856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:28.072705 18857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:28.073071 18860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:28.075439 18848 server_base.cc:1034] running on GCE node
I20260809 02:22:28.076081 18848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:28.076799 18848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:28.077965 18848 hybrid_clock.cc:648] HybridClock initialized: now 1786242148077899 us; error 81 us; skew 500 ppm
Aug 09 02:22:28 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242148, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:28.081781 18848 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:22:28.082777 18848 webserver.cc:460] Webserver started at http://127.1.81.194:43891/ using document root <none> and password file <none>
I20260809 02:22:28.083498 18848 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:28.083591 18848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:28.083894 18848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:22:28 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242148, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:22:28.100193 18848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "746ef3ae01e043fb8764cb75552593d0"
format_stamp: "Formatted at 2026-08-09 02:22:28 on dist-test-slave-jlzn"
server_key: "938c59c8749153a68889cd9a49356832"
server_key_iv: "0fbe4b219323ffd30553db796e47d8d0"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:28.100880 18848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "746ef3ae01e043fb8764cb75552593d0"
format_stamp: "Formatted at 2026-08-09 02:22:28 on dist-test-slave-jlzn"
server_key: "938c59c8749153a68889cd9a49356832"
server_key_iv: "0fbe4b219323ffd30553db796e47d8d0"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:28.112210 18848 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.002s sys 0.003s
I20260809 02:22:28.130831 18875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:28.132556 18848 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260809 02:22:28.132702 18848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "746ef3ae01e043fb8764cb75552593d0"
format_stamp: "Formatted at 2026-08-09 02:22:28 on dist-test-slave-jlzn"
server_key: "938c59c8749153a68889cd9a49356832"
server_key_iv: "0fbe4b219323ffd30553db796e47d8d0"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:28.132849 18848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:28.204658 18848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:28.208366 18848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:28.208577 18848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:28.209349 18848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:28.210421 18848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:28.210492 18848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:28.210551 18848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:28.210582 18848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:28.222528 18848 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:38829
I20260809 02:22:28.222599 19062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:38829 every 8 connection(s)
I20260809 02:22:28.223794 18848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:22:28.233790 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 18848
I20260809 02:22:28.233919 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:22:28.234212 1351 external_mini_cluster.cc:1428] Setting key b9a673e25ebb798ca2a3e7b0631f4218
Aug 09 02:22:28 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242148, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:22:28.241834 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.225924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:37907 (local address 127.1.81.254:36725)
0809 02:22:28.226049 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.226054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.228138 (+ 2084us) server_negotiation.cc:407] Connection header received
0809 02:22:28.229386 (+ 1248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.229390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.229454 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.229512 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:28.231126 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.232026 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.233788 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.234151 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.234238 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.237573 (+ 3335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:28.237578 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:28.237581 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:28.237609 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:28.239605 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:28.240264 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:28.240268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:28.240269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:28.240351 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:28.240763 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:28.240767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:28.240769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:28.240945 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:28.241031 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.241507 (+ 476us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.241632 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:22:28.242604 19069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.226395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36725 (local address 127.1.81.194:37907)
0809 02:22:28.227981 (+ 1586us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:28.228037 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:28.229129 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:28.229938 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:28.229947 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:28.230288 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:28.230942 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.230962 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.232196 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.232200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.233626 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.233639 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.234445 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.234450 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.234670 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.235383 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:28.235403 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:28.237375 (+ 1972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:28.239715 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:28.239721 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:28.239734 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:28.240134 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:28.240454 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:28.240457 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:28.240459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:28.240664 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:28.241049 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:28.241056 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:28.241281 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 02:22:28.241429 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 02:22:28.241715 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1334,"thread_start_us":155,"threads_started":1}
I20260809 02:22:28.243908 19064 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36725
I20260809 02:22:28.244128 19064 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:28.244671 19064 heartbeater.cc:511] Master 127.1.81.254:36725 requested a full tablet report, sending...
I20260809 02:22:28.245733 18489 ts_manager.cc:194] Registered new tserver with Master: 746ef3ae01e043fb8764cb75552593d0 (127.1.81.194:38829)
I20260809 02:22:28.246470 18489 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:37907
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:22:28.270915 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36725
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:22:28 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242147, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
W20260809 02:22:28.432818 19074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:28.433077 19074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:28.433135 19074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:28.437786 19074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:28.437906 19074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:28.438026 19074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:22:28.444954 19074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.81.212:49501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:22:28.446394 19074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:28.447733 19074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:28.460572 19085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:28.460539 19086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:28.462496 19090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:28.462800 19074 server_base.cc:1034] running on GCE node
I20260809 02:22:28.463524 19074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:28.464620 19074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:28.465803 19074 hybrid_clock.cc:648] HybridClock initialized: now 1786242148465781 us; error 32 us; skew 500 ppm
Aug 09 02:22:28 dist-test-slave-jlzn krb5kdc[17738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242148, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:28.469775 19074 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:22:28.470853 19074 webserver.cc:460] Webserver started at http://127.1.81.195:45633/ using document root <none> and password file <none>
I20260809 02:22:28.471602 19074 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:28.471761 19074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:28.472074 19074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:22:28 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242148, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:22:28.487733 19074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "532075d6ce3c462e8d4ca75aa05aa5aa"
format_stamp: "Formatted at 2026-08-09 02:22:28 on dist-test-slave-jlzn"
server_key: "85497c09d3e3e454f0088270306bddfc"
server_key_iv: "38241cb363e0b62f450acfa05360f47b"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:28.488579 19074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "532075d6ce3c462e8d4ca75aa05aa5aa"
format_stamp: "Formatted at 2026-08-09 02:22:28 on dist-test-slave-jlzn"
server_key: "85497c09d3e3e454f0088270306bddfc"
server_key_iv: "38241cb363e0b62f450acfa05360f47b"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:28.498951 19074 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.004s sys 0.000s
I20260809 02:22:28.521690 19101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:28.523283 19074 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:22:28.523406 19074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "532075d6ce3c462e8d4ca75aa05aa5aa"
format_stamp: "Formatted at 2026-08-09 02:22:28 on dist-test-slave-jlzn"
server_key: "85497c09d3e3e454f0088270306bddfc"
server_key_iv: "38241cb363e0b62f450acfa05360f47b"
server_key_version: "kuduclusterkey@0"
I20260809 02:22:28.523525 19074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:28.546530 19074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:28.549741 19074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:28.549917 19074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:28.550588 19074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:28.551626 19074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:28.551693 19074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:28.551836 19074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:28.551880 19074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:28.570677 19074 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:41029
I20260809 02:22:28.570719 19267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:41029 every 8 connection(s)
I20260809 02:22:28.571844 19074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:22:28.578655 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 19074
I20260809 02:22:28.578781 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:22:28.579078 1351 external_mini_cluster.cc:1428] Setting key af635623f9c9ce7eda22a85a1a41f7d6
Aug 09 02:22:28 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242148, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:22:28.588272 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.573917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:43761 (local address 127.1.81.254:36725)
0809 02:22:28.574045 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.574050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.575298 (+ 1248us) server_negotiation.cc:407] Connection header received
0809 02:22:28.576679 (+ 1381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.576683 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.576742 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.576837 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:28.578178 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.579016 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.580715 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.581030 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.581115 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.584072 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:28.584076 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:28.584079 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:28.584107 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:28.585815 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:28.586465 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:28.586468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:28.586470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:28.586566 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:28.587006 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:28.587009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:28.587011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:28.587237 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:28.587343 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.587971 (+ 628us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.588094 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:22:28.589113 19277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.574375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36725 (local address 127.1.81.195:43761)
0809 02:22:28.575137 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:28.575197 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:28.576423 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:28.577026 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:28.577034 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:28.577368 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:28.578007 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.578027 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.579177 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.579181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.580549 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.580561 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.581312 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.581316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.581520 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.582151 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:28.582172 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:28.583890 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:28.585955 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:28.585962 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:28.585977 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:28.586337 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:28.586682 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:28.586685 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:28.586687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:28.586880 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:28.587350 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:28.587357 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:28.587652 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 02:22:28.587889 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 02:22:28.588186 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":261,"threads_started":1}
I20260809 02:22:28.590226 19268 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36725
I20260809 02:22:28.590456 19268 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:28.590978 19268 heartbeater.cc:511] Master 127.1.81.254:36725 requested a full tablet report, sending...
I20260809 02:22:28.592046 18489 ts_manager.cc:194] Registered new tserver with Master: 532075d6ce3c462e8d4ca75aa05aa5aa (127.1.81.195:41029)
I20260809 02:22:28.592726 18489 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:43761
I20260809 02:22:28.596182 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:22:28.607293 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.598404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57170 (local address 127.1.81.254:36725)
0809 02:22:28.598501 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.598506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.598884 (+ 378us) server_negotiation.cc:407] Connection header received
0809 02:22:28.598979 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.598982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.599032 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.599119 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:28.599968 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.600729 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.601854 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.602179 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.602281 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.603890 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:28.603893 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:28.603896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:28.603919 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:28.605507 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:28.605987 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:28.605991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:28.605993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:28.606082 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:28.606382 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:28.606386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:28.606387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:28.606606 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:28.606708 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.607052 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.607161 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:22:28.610896 18489 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:22:28.615099 18489 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:22:28.635231 19292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.625642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:38829 (local address 127.0.0.1:43990)
0809 02:22:28.628124 (+ 2482us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:28.628166 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:28.628266 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:28.629943 (+ 1677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:28.629946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:28.629966 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:28.630065 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.630097 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.631513 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.631517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.633500 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.633513 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.634754 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.634758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.634862 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.634886 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:22:28.634957 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:22:28.635086 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2404,"thread_start_us":88,"threads_started":1}
I20260809 02:22:28.636127 19291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.626083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43990 (local address 127.1.81.194:38829)
0809 02:22:28.628487 (+ 2404us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.628498 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.628519 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:22:28.628590 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.628595 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.628804 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.628954 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:28.630230 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.631384 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.633660 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.634444 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.634548 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.634686 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.635876 (+ 1190us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.635973 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2302,"thread_start_us":119,"threads_started":1}
I20260809 02:22:28.638291 19290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.626191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:41029 (local address 127.0.0.1:55776)
0809 02:22:28.628463 (+ 2272us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:28.628474 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:28.628623 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:28.629240 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:28.629249 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:28.629271 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:28.629388 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.629395 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.630826 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.630829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.632198 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.632210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.633748 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.633752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.633861 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.633896 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 02:22:28.638090 (+ 4194us) client_negotiation.cc:240] Negotiation successful
0809 02:22:28.638165 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2219,"thread_start_us":95,"threads_started":1}
I20260809 02:22:28.638870 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.626616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55776 (local address 127.1.81.195:41029)
0809 02:22:28.626983 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.626994 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.628559 (+ 1565us) server_negotiation.cc:407] Connection header received
0809 02:22:28.628745 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.628750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.628966 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.629090 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:28.629507 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.630691 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.632355 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.633402 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.633487 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.633650 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.634613 (+ 963us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.638735 (+ 4122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":111,"threads_started":1}
I20260809 02:22:28.640226 18954 tablet_service.cc:1467] Processing CreateTablet for tablet 461a1ef15090405bb50fd1466dc75119 (DEFAULT_TABLE table=test-table [id=669bd13912644724a61ec18162a00b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:28.641409 18954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461a1ef15090405bb50fd1466dc75119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:28.641881 19149 tablet_service.cc:1467] Processing CreateTablet for tablet 461a1ef15090405bb50fd1466dc75119 (DEFAULT_TABLE table=test-table [id=669bd13912644724a61ec18162a00b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:28.642868 19149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461a1ef15090405bb50fd1466dc75119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:28.643952 19288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.624604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:45203 (local address 127.0.0.1:52412)
0809 02:22:28.628104 (+ 3500us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:28.628149 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:28.628264 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:28.638905 (+ 10641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:28.638908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:28.638925 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:28.639118 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.639129 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.640646 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.640650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.642493 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.642504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.643578 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.643583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.643672 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.643697 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:22:28.643749 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 02:22:28.643826 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3332,"thread_start_us":80,"threads_started":1}
I20260809 02:22:28.644672 19289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.624733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.1.81.193:45203)
0809 02:22:28.634163 (+ 9430us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.634169 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.634190 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:22:28.634260 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.634265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.634440 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.638719 (+ 4279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:28.639313 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.640505 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.642646 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.643433 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.644225 (+ 792us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.644364 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.644412 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.644537 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9325,"thread_start_us":91,"threads_started":1}
I20260809 02:22:28.647204 18740 tablet_service.cc:1467] Processing CreateTablet for tablet 461a1ef15090405bb50fd1466dc75119 (DEFAULT_TABLE table=test-table [id=669bd13912644724a61ec18162a00b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:28.648205 18740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461a1ef15090405bb50fd1466dc75119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:28.656657 19295 tablet_bootstrap.cc:492] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Bootstrap starting.
I20260809 02:22:28.659853 19295 tablet_bootstrap.cc:654] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:28.661257 19295 log.cc:824] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:28.661846 19299 tablet_bootstrap.cc:492] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: Bootstrap starting.
I20260809 02:22:28.664462 19299 tablet_bootstrap.cc:654] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:28.665261 19299 log.cc:824] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:28.665658 19297 tablet_bootstrap.cc:492] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d: Bootstrap starting.
I20260809 02:22:28.668565 19297 tablet_bootstrap.cc:654] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:28.669338 19297 log.cc:824] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:28.672824 19295 tablet_bootstrap.cc:492] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: No bootstrap required, opened a new log
I20260809 02:22:28.672892 19297 tablet_bootstrap.cc:492] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d: No bootstrap required, opened a new log
I20260809 02:22:28.673043 19295 ts_tablet_manager.cc:1397] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20260809 02:22:28.673061 19297 ts_tablet_manager.cc:1397] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260809 02:22:28.677241 19297 raft_consensus.cc:348] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
I20260809 02:22:28.677625 19297 raft_consensus.cc:374] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:28.677719 19297 raft_consensus.cc:729] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58fb34e3c5934abfa2c2c22368dad81d, State: Initialized, Role: FOLLOWER
I20260809 02:22:28.679461 19297 consensus_queue.cc:260] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
I20260809 02:22:28.679970 19295 raft_consensus.cc:348] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
I20260809 02:22:28.680290 19295 raft_consensus.cc:374] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:28.680400 19295 raft_consensus.cc:729] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746ef3ae01e043fb8764cb75552593d0, State: Initialized, Role: FOLLOWER
I20260809 02:22:28.680895 19295 consensus_queue.cc:260] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
I20260809 02:22:28.681239 19297 ts_tablet_manager.cc:1428] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260809 02:22:28.681623 18839 heartbeater.cc:503] Master 127.1.81.254:36725 was elected leader, sending a full tablet report...
I20260809 02:22:28.681923 19295 ts_tablet_manager.cc:1428] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260809 02:22:28.682423 19064 heartbeater.cc:503] Master 127.1.81.254:36725 was elected leader, sending a full tablet report...
I20260809 02:22:28.685271 19299 tablet_bootstrap.cc:492] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: No bootstrap required, opened a new log
I20260809 02:22:28.685518 19299 ts_tablet_manager.cc:1397] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20260809 02:22:28.689481 19299 raft_consensus.cc:348] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
Aug 09 02:22:28 dist-test-slave-jlzn krb5kdc[17738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242147, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:22:28.690390 19299 raft_consensus.cc:374] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:28.690541 19299 raft_consensus.cc:729] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532075d6ce3c462e8d4ca75aa05aa5aa, State: Initialized, Role: FOLLOWER
I20260809 02:22:28.691020 19299 consensus_queue.cc:260] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
I20260809 02:22:28.691716 19268 heartbeater.cc:503] Master 127.1.81.254:36725 was elected leader, sending a full tablet report...
I20260809 02:22:28.692083 19299 ts_tablet_manager.cc:1428] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:22:28.704692 19306 raft_consensus.cc:482] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:22:28.704855 19306 raft_consensus.cc:504] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
I20260809 02:22:28.705971 19306 leader_election.cc:288] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746ef3ae01e043fb8764cb75552593d0 (127.1.81.194:38829), 532075d6ce3c462e8d4ca75aa05aa5aa (127.1.81.195:41029)
I20260809 02:22:28.717636 19291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.706541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:40387 (local address 127.1.81.194:38829)
0809 02:22:28.706661 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.706666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.709623 (+ 2957us) server_negotiation.cc:407] Connection header received
0809 02:22:28.709830 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.709833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.709884 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.709934 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:28.710687 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.711459 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.716305 (+ 4846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.716896 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.716994 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.717048 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.717424 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.717505 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:22:28.718253 19313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.706165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:38829 (local address 127.1.81.193:40387)
0809 02:22:28.709533 (+ 3368us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:28.709548 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:28.709709 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:28.710093 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:28.710097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:28.710117 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:28.710536 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.710548 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.711646 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.711649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.712945 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.712957 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.717172 (+ 4215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.717175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.717274 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.717299 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:22:28.717992 (+ 693us) client_negotiation.cc:240] Negotiation successful
0809 02:22:28.718086 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3286,"thread_start_us":116,"threads_started":1}
I20260809 02:22:28.719008 18958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461a1ef15090405bb50fd1466dc75119" candidate_uuid: "58fb34e3c5934abfa2c2c22368dad81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746ef3ae01e043fb8764cb75552593d0" is_pre_election: true
I20260809 02:22:28.719311 18958 raft_consensus.cc:2454] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58fb34e3c5934abfa2c2c22368dad81d in term 0.
I20260809 02:22:28.719906 18662 leader_election.cc:302] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58fb34e3c5934abfa2c2c22368dad81d, 746ef3ae01e043fb8764cb75552593d0; no voters:
I20260809 02:22:28.720129 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.709255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:43109 (local address 127.1.81.195:41029)
0809 02:22:28.709360 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.709364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.713251 (+ 3887us) server_negotiation.cc:407] Connection header received
0809 02:22:28.713429 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.713432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.713479 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.713524 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:28.713915 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.714609 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.718855 (+ 4246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.719443 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.719536 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.719581 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.719928 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.720005 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:22:28.720206 19306 raft_consensus.cc:2781] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:22:28.720281 19306 raft_consensus.cc:482] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:22:28.720319 19306 raft_consensus.cc:3037] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:28.720517 19310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.708743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:41029 (local address 127.1.81.193:43109)
0809 02:22:28.713174 (+ 4431us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:28.713187 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:28.713315 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:28.713660 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:28.713663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:28.713681 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:28.713782 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.713790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.714956 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.714959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.716152 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:28.716165 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.719676 (+ 3511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.719679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:28.719773 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.719794 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:22:28.720316 (+ 522us) client_negotiation.cc:240] Negotiation successful
0809 02:22:28.720386 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4368,"thread_start_us":241,"threads_started":1}
I20260809 02:22:28.721074 19193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461a1ef15090405bb50fd1466dc75119" candidate_uuid: "58fb34e3c5934abfa2c2c22368dad81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" is_pre_election: true
I20260809 02:22:28.721336 19193 raft_consensus.cc:2454] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58fb34e3c5934abfa2c2c22368dad81d in term 0.
I20260809 02:22:28.721638 19306 raft_consensus.cc:504] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
I20260809 02:22:28.721967 19306 leader_election.cc:288] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [CANDIDATE]: Term 1 election: Requested vote from peers 746ef3ae01e043fb8764cb75552593d0 (127.1.81.194:38829), 532075d6ce3c462e8d4ca75aa05aa5aa (127.1.81.195:41029)
I20260809 02:22:28.722296 19193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461a1ef15090405bb50fd1466dc75119" candidate_uuid: "58fb34e3c5934abfa2c2c22368dad81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa"
I20260809 02:22:28.722409 19193 raft_consensus.cc:3037] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:28.722910 18958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461a1ef15090405bb50fd1466dc75119" candidate_uuid: "58fb34e3c5934abfa2c2c22368dad81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746ef3ae01e043fb8764cb75552593d0"
I20260809 02:22:28.723016 18958 raft_consensus.cc:3037] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:28.723574 19193 raft_consensus.cc:2454] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58fb34e3c5934abfa2c2c22368dad81d in term 1.
I20260809 02:22:28.723968 18664 leader_election.cc:302] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 532075d6ce3c462e8d4ca75aa05aa5aa, 58fb34e3c5934abfa2c2c22368dad81d; no voters:
I20260809 02:22:28.724273 18958 raft_consensus.cc:2454] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58fb34e3c5934abfa2c2c22368dad81d in term 1.
I20260809 02:22:28.724469 19306 raft_consensus.cc:2781] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:22:28.724676 19306 raft_consensus.cc:686] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [term 1 LEADER]: Becoming Leader. State: Replica: 58fb34e3c5934abfa2c2c22368dad81d, State: Running, Role: LEADER
I20260809 02:22:28.724987 19306 consensus_queue.cc:237] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } }
W20260809 02:22:28.728004 19067 tablet.cc:2369] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:22:28.728197 18489 catalog_manager.cc:5495] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d reported cstate change: term changed from 0 to 1, leader changed from <none> to 58fb34e3c5934abfa2c2c22368dad81d (127.1.81.193). New cstate: current_term: 1 leader_uuid: "58fb34e3c5934abfa2c2c22368dad81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58fb34e3c5934abfa2c2c22368dad81d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 } health_report { overall_health: UNKNOWN } } }
I20260809 02:22:28.760793 19289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:28.755329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52426 (local address 127.1.81.193:45203)
0809 02:22:28.755773 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:28.755777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:28.755790 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:22:28.755890 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:28.755893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:28.755956 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:28.756047 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:22:28.756410 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.757189 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.758430 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:28.758734 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:28.758828 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:28.759258 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:22:28.759856 (+ 598us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:22:28.759984 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:28.760542 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 02:22:28.760660 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365}
I20260809 02:22:28.768894 19193 raft_consensus.cc:1261] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 1 FOLLOWER]: Refusing update from remote peer 58fb34e3c5934abfa2c2c22368dad81d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:22:28.768939 18958 raft_consensus.cc:1261] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 1 FOLLOWER]: Refusing update from remote peer 58fb34e3c5934abfa2c2c22368dad81d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:22:28.769583 19315 consensus_queue.cc:1035] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "532075d6ce3c462e8d4ca75aa05aa5aa" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 41029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:22:28.769785 19306 consensus_queue.cc:1035] T 461a1ef15090405bb50fd1466dc75119 P 58fb34e3c5934abfa2c2c22368dad81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "746ef3ae01e043fb8764cb75552593d0" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:22:28.782099 19323 mvcc.cc:205] Tried to move back new op lower bound from 7316447841349623808 to 7316447841180372992. Current Snapshot: MvccSnapshot[applied={T|T < 7316447841349623808}]
I20260809 02:22:28.785069 19324 mvcc.cc:205] Tried to move back new op lower bound from 7316447841349623808 to 7316447841180372992. Current Snapshot: MvccSnapshot[applied={T|T < 7316447841349623808}]
I20260809 02:22:28.789826 19325 mvcc.cc:205] Tried to move back new op lower bound from 7316447841349623808 to 7316447841180372992. Current Snapshot: MvccSnapshot[applied={T|T < 7316447841349623808}]
I20260809 02:22:28.807156 18480 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:22:28.807333 18480 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:22:28.810212 18480 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4db0372b0ff947ea943fa75cd8a1ee12: Sending DeleteTablet for 3 replicas of tablet 461a1ef15090405bb50fd1466dc75119
I20260809 02:22:28.811452 18954 tablet_service.cc:1514] Processing DeleteTablet for tablet 461a1ef15090405bb50fd1466dc75119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:28 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:43990
I20260809 02:22:28.811617 18740 tablet_service.cc:1514] Processing DeleteTablet for tablet 461a1ef15090405bb50fd1466dc75119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:28 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:52412
I20260809 02:22:28.812268 19149 tablet_service.cc:1514] Processing DeleteTablet for tablet 461a1ef15090405bb50fd1466dc75119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:28 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55776
I20260809 02:22:28.813745 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 18632
I20260809 02:22:28.829739 19338 tablet_replica.cc:330] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: stopping tablet replica
I20260809 02:22:28.830092 19338 raft_consensus.cc:2229] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:22:28.830451 19338 raft_consensus.cc:2258] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:22:28.830848 19334 tablet_replica.cc:330] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: stopping tablet replica
I20260809 02:22:28.831185 19334 raft_consensus.cc:2229] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:22:28.831573 19334 raft_consensus.cc:2258] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:22:28.832258 19338 ts_tablet_manager.cc:1905] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:22:28.837642 19338 ts_tablet_manager.cc:1918] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:22:28.837811 19338 log.cc:1196] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/461a1ef15090405bb50fd1466dc75119
I20260809 02:22:28.838181 19334 ts_tablet_manager.cc:1905] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:22:28.838259 19338 ts_tablet_manager.cc:1939] T 461a1ef15090405bb50fd1466dc75119 P 532075d6ce3c462e8d4ca75aa05aa5aa: Deleting consensus metadata
I20260809 02:22:28.839699 18457 catalog_manager.cc:4841] TS 532075d6ce3c462e8d4ca75aa05aa5aa (127.1.81.195:41029): tablet 461a1ef15090405bb50fd1466dc75119 (table test-table [id=669bd13912644724a61ec18162a00b98]) successfully deleted
I20260809 02:22:28.840783 19334 ts_tablet_manager.cc:1918] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:22:28.840898 19334 log.cc:1196] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/461a1ef15090405bb50fd1466dc75119
I20260809 02:22:28.841203 19334 ts_tablet_manager.cc:1939] T 461a1ef15090405bb50fd1466dc75119 P 746ef3ae01e043fb8764cb75552593d0: Deleting consensus metadata
W20260809 02:22:28.842417 18456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:45203 (error 108)
I20260809 02:22:28.842911 18456 catalog_manager.cc:4841] TS 746ef3ae01e043fb8764cb75552593d0 (127.1.81.194:38829): tablet 461a1ef15090405bb50fd1466dc75119 (table test-table [id=669bd13912644724a61ec18162a00b98]) successfully deleted
W20260809 02:22:28.844007 19288 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:22:28.843232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:45203 (local address 127.0.0.1:52436)
0809 02:22:28.843455 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:28.843471 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:28.843560 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:28.843739 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:45203: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":136}
W20260809 02:22:28.844298 18456 catalog_manager.cc:4584] TS 58fb34e3c5934abfa2c2c22368dad81d (127.1.81.193:45203): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 461a1ef15090405bb50fd1466dc75119: Network error: Client connection negotiation failed: client connection to 127.1.81.193:45203: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:22:28.844974 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 18848
I20260809 02:22:28.860857 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 19074
I20260809 02:22:28.893143 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 18430
I20260809 02:22:28.905457 1351 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 02:22:29.249094 1351 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 02:22:29.249231 1351 mini_ranger.cc:66] Stopping Ranger...
I20260809 02:22:29.593369 1351 mini_ranger.cc:68] Stopped Ranger
2026-08-09 02:22:29.593 UTC [17789] LOG: received smart shutdown request
2026-08-09 02:22:29.597 UTC [17789] LOG: background worker "logical replication launcher" (PID 17804) exited with exit code 1
2026-08-09 02:22:29.597 UTC [17794] LOG: shutting down
2026-08-09 02:22:29.723 UTC [17789] LOG: database system is shut down
2026-08-09T02:22:29Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45696 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:22:29 dist-test-slave-jlzn krb5kdc[19349](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:22:29 dist-test-slave-jlzn krb5kdc[19349](info): set up 2 sockets
Aug 09 02:22:29 dist-test-slave-jlzn krb5kdc[19349](info): commencing operation
krb5kdc: starting...
W20260809 02:22:30.955427 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:22:31 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:22:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:22:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.81.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.81.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/rangeradmin_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/rangeradmin_127.1.81.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.81.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.81.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/rangerlookup_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/rangerlookup_127.1.81.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.81.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.81.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/HTTP_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/HTTP_127.1.81.212@KRBTEST.COM.keytab.
I20260809 02:22:31.103863 1351 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskAskc7b/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/postgres -l logfile start
2026-08-09 02:22:33.201 UTC [19396] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 02:22:33.201 UTC [19396] LOG: listening on IPv4 address "127.1.81.212", port 37103
2026-08-09 02:22:33.204 UTC [19396] LOG: listening on Unix socket "/tmp/.s.PGSQL.37103"
2026-08-09 02:22:33.223 UTC [19399] LOG: database system was shut down at 2026-08-09 02:22:32 UTC
2026-08-09 02:22:33.226 UTC [19396] LOG: database system is ready to accept connections
I20260809 02:22:34.269912 1351 mini_postgres.cc:96] Postgres bound to 37103
2026-08-09 02:22:34.277 UTC [19409] FATAL: database "slave" does not exist
127.1.81.212:37103 - accepting connections
I20260809 02:22:34.277778 1351 mini_ranger.cc:161] Starting Ranger...
I20260809 02:22:34.292382 1351 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 02:22:34.664973 1351 mini_ranger.cc:87] Created ranger Postgres database
I20260809 02:22:34.665060 1351 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-admin
2026-08-09 02:22:34,949 [I] DB FLAVOR :POSTGRES
2026-08-09 02:22:34,949 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:22:34,949 [I] Checking connection..
2026-08-09 02:22:34,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 02:22:35,185 [I] Checking connection passed.
2026-08-09 02:22:35,185 [I] --------- Verifying version history table ---------
2026-08-09 02:22:35,185 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:22:35,431 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:22:35,432 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:22:35,684 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:22:35,685 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 02:22:35,685 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 02:22:35.901 UTC [19513] WARNING: there is no transaction in progress
2026-08-09 02:22:35,910 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 02:22:35,910 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:22:36,163 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 02:22:36,164 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:22:36,164 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 02:22:36,398 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 02:22:36,622 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jlzn.c.gcp-upstream.internal','N') ;"
2026-08-09 02:22:36,858 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:22:37,111 [I] Table x_portal_user does not exist in database ranger
2026-08-09 02:22:37,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:22:37,366 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 02:22:37,366 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:22:37,600 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:22:37,854 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 02:22:37,855 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 02:22:38.695 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.709 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.722 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.735 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.751 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.769 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.822 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.828 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.840 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.849 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.858 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.870 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.879 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.884 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.889 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:38.894 UTC [19673] WARNING: there is no transaction in progress
2026-08-09 02:22:39,414 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 02:22:39,415 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 02:22:39,647 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 02:22:39,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:22:39,900 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 02:22:39,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:22:40,152 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 02:22:40,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:22:40,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:22:40,654 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jlzn.c.gcp-upstream.internal';"
2026-08-09 02:22:40,876 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 02:22:40,876 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 02:22:41,108 [I] DB_PATCHES have already been applied
I20260809 02:22:41.113907 1351 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-admin:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskAskc7b/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 02:22:41.113968 1351 mini_ranger.cc:193] Using host: 127.1.81.212
I20260809 02:22:41.118070 1351 mini_ranger.cc:227] Ranger admin URL: http://127.1.81.212:55817
Aug 09, 2026 2:22:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:22:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:22:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 2:22:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 2:22:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 2:22:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 2:22:41 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 02:22:42.297771 1351 mini_ranger.cc:160] Time spent starting Ranger: real 8.020s user 0.004s sys 0.006s
Aug 09, 2026 2:23:01 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 2:23:01 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 2:23:01 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 2:23:01 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 2:23:02 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 02:23:03.136255 1351 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.81.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.81.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/rangerkms_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.81.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/rangerkms_127.1.81.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.81.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.81.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.81.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/HTTP_127.1.81.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.81.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/HTTP_127.1.81.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 02:23:03 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242183, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 02:23:03.212795 1351 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 02:23:03.222043 1351 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 02:23:04.006486 1351 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 02:23:04.006577 1351 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms
I20260809 02:23:04.006599 1351 mini_ranger_kms.cc:227] Using postgres at 127.1.81.212:37103
2026-08-09 02:23:04,241 [I] DB FLAVOR :POSTGRES
2026-08-09 02:23:04,241 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:23:04,241 [I] Checking connection
2026-08-09 02:23:04,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 02:23:04,471 [I] connection success
2026-08-09 02:23:04,472 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 02:23:04,472 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 02:23:04,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 02:23:04,697 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 02:23:04,697 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:23:04,697 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 02:23:04,697 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.81.212:37103/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 02:23:04,950 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 02:23:05.383970 1351 mini_ranger_kms.cc:310] Created kms service
I20260809 02:23:05.543927 1351 mini_ranger_kms.cc:326] Created kudu user
I20260809 02:23:05.584795 1351 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 02:23:05 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242183, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:05.958343 1351 mini_ranger_kms.cc:384] Added ranger policy
I20260809 02:23:05.958505 1351 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms:/tmp/dist-test-taskAskc7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskAskc7b/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 02:23:05.958536 1351 mini_ranger_kms.cc:240] Using host: 127.1.81.212
I20260809 02:23:05.963265 1351 mini_ranger_kms.cc:276] Ranger KMS PID: 19964
I20260809 02:23:05.963340 1351 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.81.212:49923
Aug 09, 2026 2:23:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:23:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:23:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 2:23:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 2:23:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 2:23:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 02:23:07 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242187, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.81.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 02:23:08 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242187, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.81.212@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:08.421346 1351 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.209s user 0.014s sys 0.205s
I20260809 02:23:08.421461 1351 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 02:23:08.421523 1351 mini_ranger_kms.cc:401] 127.1.81.212:49923/kms/v1/keys
Aug 09 02:23:08 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242187, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.81.212@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
Aug 09 02:23:10 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:23:10.944514 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:37007
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:37007
--ranger_config_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49923/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:11.054551 20047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:11.054798 20047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:11.054853 20047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:11.058772 20047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:11.058830 20047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:11.058856 20047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:11.058876 20047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:11.058902 20047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:11.064070 20047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.81.212:49923/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:37007
--ranger_config_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:37007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:11.064975 20047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:11.065908 20047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:23:11.074400 20047 server_base.cc:1034] running on GCE node
W20260809 02:23:11.074399 20054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:11.074440 20053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:11.074416 20056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:11.075119 20047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:11.076143 20047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:11.077296 20047 hybrid_clock.cc:648] HybridClock initialized: now 1786242191077283 us; error 26 us; skew 500 ppm
Aug 09 02:23:11 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242191, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:11.079905 20047 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:23:11.080686 20047 webserver.cc:460] Webserver started at http://127.1.81.254:42875/ using document root <none> and password file <none>
I20260809 02:23:11.081173 20047 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:11.081230 20047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:11.081426 20047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:23:11 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242191, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:11.142712 20047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "4fe665d4ebf249c7bf0344d6668ad324"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-jlzn"
server_key: "2ce3397d8968e83836ce5ae25e1aea80"
server_key_iv: "8dc448073b4654df4010b04686cb9645"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:11.143342 20047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "4fe665d4ebf249c7bf0344d6668ad324"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-jlzn"
server_key: "2ce3397d8968e83836ce5ae25e1aea80"
server_key_iv: "8dc448073b4654df4010b04686cb9645"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:11.147219 20047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:23:11.160635 20065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.161937 20047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:11.162060 20047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "4fe665d4ebf249c7bf0344d6668ad324"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-jlzn"
server_key: "2ce3397d8968e83836ce5ae25e1aea80"
server_key_iv: "8dc448073b4654df4010b04686cb9645"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:11.162177 20047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:11.174356 20047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:11.177016 20047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:11.177186 20047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:11.184717 20047 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:37007
I20260809 02:23:11.184732 20141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:37007 every 8 connection(s)
I20260809 02:23:11.185696 20047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:11.188441 20142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:11.190874 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 20047
I20260809 02:23:11.191008 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:23:11.191332 1351 external_mini_cluster.cc:1428] Setting key 06c91357a342c2121ce470c87430c0aa
I20260809 02:23:11.194703 20142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Bootstrap starting.
I20260809 02:23:11.197290 20142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:11.198063 20142 log.cc:824] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:11.200145 20142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: No bootstrap required, opened a new log
Aug 09 02:23:11 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:11.203900 20142 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } }
I20260809 02:23:11.204116 20142 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:11.204191 20142 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe665d4ebf249c7bf0344d6668ad324, State: Initialized, Role: FOLLOWER
I20260809 02:23:11.204613 20142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } }
I20260809 02:23:11.204779 20142 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:11.204879 20142 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:11.204984 20142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:11.205924 20142 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } }
I20260809 02:23:11.206247 20142 leader_election.cc:302] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe665d4ebf249c7bf0344d6668ad324; no voters:
I20260809 02:23:11.206555 20142 leader_election.cc:288] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:11.206637 20149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:11.206902 20149 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 1 LEADER]: Becoming Leader. State: Replica: 4fe665d4ebf249c7bf0344d6668ad324, State: Running, Role: LEADER
I20260809 02:23:11.207242 20149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } }
I20260809 02:23:11.207894 20142 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:11.208225 20147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.193028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54000 (local address 127.1.81.254:37007)
0809 02:23:11.193515 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.193534 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.193578 (+ 44us) server_negotiation.cc:407] Connection header received
0809 02:23:11.194360 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.194382 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.194785 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.195129 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:11.195997 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.197423 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.198715 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.199367 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.199524 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.202537 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:11.202545 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:11.202562 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:11.202592 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:11.204576 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:11.205081 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:11.205088 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:11.205093 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:11.205228 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:11.205534 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:11.205537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:11.205539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:11.206010 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:11.206207 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.206991 (+ 784us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.207260 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":136,"threads_started":1}
I20260809 02:23:11.208478 20149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe665d4ebf249c7bf0344d6668ad324. Latest consensus state: current_term: 1 leader_uuid: "4fe665d4ebf249c7bf0344d6668ad324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } } }
I20260809 02:23:11.208652 20149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:11.208906 20149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fe665d4ebf249c7bf0344d6668ad324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } } }
I20260809 02:23:11.209059 20149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:11.209448 20155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:11.212627 20155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:11.213037 20142 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:23:11.221962 20177 mvcc.cc:205] Tried to move back new op lower bound from 7316448015240257536 to 7316448015185924096. Current Snapshot: MvccSnapshot[applied={T|T < 7316448015240257536}]
I20260809 02:23:11.225226 20155 catalog_manager.cc:1347] Generated new cluster ID: ab2af7a4d78b43329d8fc09c838a1426
I20260809 02:23:11.225282 20155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:11.263849 20155 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:11.266010 20155 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:11.274667 20155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Generated new TSK 0
I20260809 02:23:11.275477 20155 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:23:11.937330 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37007
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:12.081228 20205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:12.081521 20205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:12.081565 20205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:12.085585 20205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:12.085704 20205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:12.085836 20205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:23:12.091939 20205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.81.212:49923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:12.092962 20205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:12.093978 20205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:12.105538 20222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:12.105917 20216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:12.107254 20205 server_base.cc:1034] running on GCE node
W20260809 02:23:12.108035 20215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:12.108564 20205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:12.109294 20205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:12.116662 20205 hybrid_clock.cc:648] HybridClock initialized: now 1786242192116625 us; error 44 us; skew 500 ppm
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:12.120402 20205 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:23:12.121376 20205 webserver.cc:460] Webserver started at http://127.1.81.193:46797/ using document root <none> and password file <none>
I20260809 02:23:12.122022 20205 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:12.122076 20205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:12.122239 20205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:12.138258 20205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "5eb9acc42f90ae731f3c2df3bafd0925"
server_key_iv: "bcc9230942d4e8a5912cbf90e06be33b"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.139077 20205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "5eb9acc42f90ae731f3c2df3bafd0925"
server_key_iv: "bcc9230942d4e8a5912cbf90e06be33b"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.146476 20205 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260809 02:23:12.169332 20236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.171079 20205 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260809 02:23:12.171284 20205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "5eb9acc42f90ae731f3c2df3bafd0925"
server_key_iv: "bcc9230942d4e8a5912cbf90e06be33b"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.171517 20205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:12.239691 20205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:12.245007 20205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:12.245214 20205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:12.245910 20205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:12.246966 20205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:12.247072 20205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.247154 20205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:12.247195 20205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.257944 20205 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:40683
I20260809 02:23:12.258177 20417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:40683 every 8 connection(s)
I20260809 02:23:12.259038 20205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:12.269160 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 20205
I20260809 02:23:12.269292 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:12.269577 1351 external_mini_cluster.cc:1428] Setting key 749386ee05ba8459351607d990d7230f
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:12.277952 20421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:12.261511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37007 (local address 127.1.81.193:55659)
0809 02:23:12.262633 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:12.262685 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:12.263731 (+ 1046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:12.264347 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:12.264355 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:12.264697 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:12.265336 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:12.265356 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.266538 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.266542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:12.267925 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:12.267937 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.268591 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.268595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:12.268788 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:12.269410 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:12.269429 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:12.272236 (+ 2807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:12.274390 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:12.274396 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:12.274411 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:12.275037 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:12.275388 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:12.275391 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:12.275393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:12.275587 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:12.276148 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:12.276155 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:12.276448 (+ 293us) client_negotiation.cc:769] Sending connection context
0809 02:23:12.276643 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 02:23:12.276947 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"thread_start_us":145,"threads_started":1}
I20260809 02:23:12.278692 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:12.261127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:55659 (local address 127.1.81.254:37007)
0809 02:23:12.261741 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:12.261749 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:12.262795 (+ 1046us) server_negotiation.cc:407] Connection header received
0809 02:23:12.263975 (+ 1180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:12.263979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:12.264035 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:12.264148 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:12.265500 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.266370 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.268057 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.268442 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.268552 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:12.272411 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:12.272415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:12.272418 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:12.272445 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:12.274252 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:12.275172 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:12.275176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:12.275178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:12.275277 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:12.275709 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:12.275712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:12.275714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:12.275981 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:12.276092 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:12.278396 (+ 2304us) server_negotiation.cc:299] Negotiation successful
0809 02:23:12.278524 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":105,"threads_started":1}
I20260809 02:23:12.279857 20418 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37007
I20260809 02:23:12.280098 20418 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:12.280632 20418 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:12.282210 20088 ts_manager.cc:194] Registered new tserver with Master: 54a0f8a4fd9249e8a4cefb6f4b1ca821 (127.1.81.193:40683)
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:23:12.284042 20088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:55659
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:23:12.301034 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37007
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:12.444756 20426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:12.445052 20426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:12.445117 20426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:12.450023 20426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:12.450081 20426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:12.450158 20426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:23:12.455646 20426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.81.212:49923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:12.456821 20426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:12.458011 20426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:12.468714 20437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:12.468741 20433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:12.468743 20434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:12.469293 20426 server_base.cc:1034] running on GCE node
I20260809 02:23:12.469681 20426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:12.470255 20426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:12.471426 20426 hybrid_clock.cc:648] HybridClock initialized: now 1786242192471396 us; error 53 us; skew 500 ppm
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:12.474172 20426 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:23:12.475023 20426 webserver.cc:460] Webserver started at http://127.1.81.194:45325/ using document root <none> and password file <none>
I20260809 02:23:12.475534 20426 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:12.475594 20426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:12.475787 20426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:12.502751 20426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "6884109be588440597d72fa8ed1f478c"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "fcdad8b477d41676a72969160c0d26ea"
server_key_iv: "37e84451540a5400372573ae765b12f7"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.504899 20426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "6884109be588440597d72fa8ed1f478c"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "fcdad8b477d41676a72969160c0d26ea"
server_key_iv: "37e84451540a5400372573ae765b12f7"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.524349 20426 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.004s sys 0.000s
I20260809 02:23:12.552162 20447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.554258 20426 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.002s sys 0.000s
I20260809 02:23:12.554392 20426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "6884109be588440597d72fa8ed1f478c"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "fcdad8b477d41676a72969160c0d26ea"
server_key_iv: "37e84451540a5400372573ae765b12f7"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.554528 20426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:12.574165 20426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:12.577790 20426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:12.578033 20426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:12.578758 20426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:12.579902 20426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:12.580008 20426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.580120 20426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:12.580188 20426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.595118 20426 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:42077
I20260809 02:23:12.595192 20602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:42077 every 8 connection(s)
I20260809 02:23:12.596475 20426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:12.601868 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 20426
I20260809 02:23:12.602003 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:12.602312 1351 external_mini_cluster.cc:1428] Setting key d6f0f29e5dfe3c5c8d03433c26270cc0
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:12.614046 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:12.600009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:38785 (local address 127.1.81.254:37007)
0809 02:23:12.600241 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:12.600245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:12.600486 (+ 241us) server_negotiation.cc:407] Connection header received
0809 02:23:12.601739 (+ 1253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:12.601743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:12.601804 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:12.601862 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:12.603863 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.604598 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.606188 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.606561 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.606732 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:12.609641 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:12.609646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:12.609649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:12.609678 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:12.611453 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:12.612220 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:12.612224 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:12.612226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:12.612327 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:12.612760 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:12.612764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:12.612766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:12.612988 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:12.613076 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:12.613750 (+ 674us) server_negotiation.cc:299] Negotiation successful
0809 02:23:12.613881 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260809 02:23:12.614956 20607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:12.598938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37007 (local address 127.1.81.194:38785)
0809 02:23:12.600296 (+ 1358us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:12.600352 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:12.601416 (+ 1064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:12.602283 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:12.602291 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:12.602621 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:12.603656 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:12.603675 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.604754 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.604757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:12.606001 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:12.606014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.606905 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.606909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:12.607109 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:12.607738 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:12.607759 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:12.609469 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:12.611598 (+ 2129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:12.611604 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:12.611617 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:12.612003 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:12.612449 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:12.612452 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:12.612454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:12.612638 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:12.613157 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:12.613163 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:12.613444 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 02:23:12.613668 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 02:23:12.613987 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1124,"thread_start_us":150,"threads_started":1}
I20260809 02:23:12.616124 20604 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37007
I20260809 02:23:12.616366 20604 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:12.616894 20604 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:12.618006 20088 ts_manager.cc:194] Registered new tserver with Master: 6884109be588440597d72fa8ed1f478c (127.1.81.194:42077)
I20260809 02:23:12.618712 20088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:38785
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:23:12.651398 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37007
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
W20260809 02:23:12.791251 20611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:12.791488 20611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:12.791561 20611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:12.797318 20611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:12.797454 20611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:12.797583 20611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:23:12.805106 20611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.81.212:49923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:12.806519 20611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:12.808010 20611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:12.820653 20619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:12.820801 20618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:12.821103 20623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:12.821760 20611 server_base.cc:1034] running on GCE node
I20260809 02:23:12.822254 20611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:12.823026 20611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:12.824285 20611 hybrid_clock.cc:648] HybridClock initialized: now 1786242192824264 us; error 34 us; skew 500 ppm
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:12.827919 20611 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:23:12.828939 20611 webserver.cc:460] Webserver started at http://127.1.81.195:43369/ using document root <none> and password file <none>
I20260809 02:23:12.829591 20611 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:12.829680 20611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:12.829975 20611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:12.853032 20611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "a7cadd38d8d66157a190b6a7be8acddc"
server_key_iv: "27c8baa03dce5f7a909a3da0218cba4d"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.853770 20611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "a7cadd38d8d66157a190b6a7be8acddc"
server_key_iv: "27c8baa03dce5f7a909a3da0218cba4d"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.859418 20611 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 02:23:12.884764 20633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.886585 20611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:12.886891 20611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "a7cadd38d8d66157a190b6a7be8acddc"
server_key_iv: "27c8baa03dce5f7a909a3da0218cba4d"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:12.887121 20611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:12.910343 20611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:12.913035 20611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:12.913196 20611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:12.913770 20611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:12.914592 20611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:12.914685 20611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.914762 20611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:12.914793 20611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:12.928114 20611 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:43271
I20260809 02:23:12.929214 20611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:12.929791 20821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:43271 every 8 connection(s)
I20260809 02:23:12.936975 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 20611
I20260809 02:23:12.937089 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:12.937371 1351 external_mini_cluster.cc:1428] Setting key 8de0f712f2fc4b7d8bba9c8d94a0e7f6
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:12.948163 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:12.931896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:45899 (local address 127.1.81.254:37007)
0809 02:23:12.932013 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:12.932017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:12.933925 (+ 1908us) server_negotiation.cc:407] Connection header received
0809 02:23:12.935078 (+ 1153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:12.935082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:12.935139 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:12.935188 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:12.936708 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.937540 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.941065 (+ 3525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.941402 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.941522 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:12.944343 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:12.944347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:12.944349 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:12.944376 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:12.945928 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:12.946489 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:12.946493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:12.946495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:12.946582 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:12.946975 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:12.946979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:12.946980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:12.947215 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:12.947327 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:12.947904 (+ 577us) server_negotiation.cc:299] Negotiation successful
0809 02:23:12.948018 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:23:12.949627 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:12.932363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37007 (local address 127.1.81.195:45899)
0809 02:23:12.933771 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:12.933825 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:12.934838 (+ 1013us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:12.935569 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:12.935577 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:12.935930 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:12.936533 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:12.936550 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.937934 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.937938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:12.940881 (+ 2943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:12.940893 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:12.941572 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:12.941576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:12.941775 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:12.942391 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:12.942411 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:12.944165 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:12.946056 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:12.946062 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:12.946076 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:12.946375 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:12.946679 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:12.946682 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:12.946685 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:12.946853 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:12.947322 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:12.947327 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:12.947600 (+ 273us) client_negotiation.cc:769] Sending connection context
0809 02:23:12.948357 (+ 757us) client_negotiation.cc:240] Negotiation successful
0809 02:23:12.948648 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":248,"threads_started":1}
I20260809 02:23:12.951156 20822 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37007
I20260809 02:23:12.951361 20822 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:12.951905 20822 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:12.952919 20088 ts_manager.cc:194] Registered new tserver with Master: dff4c664a1604f5dbd67b4f8a5b9c48f (127.1.81.195:43271)
I20260809 02:23:12.953588 20088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:45899
I20260809 02:23:12.962774 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:12.963639 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 20205
I20260809 02:23:12.981935 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 20426
Aug 09 02:23:12 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:13.005643 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 20611
I20260809 02:23:13.031127 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 20047
I20260809 02:23:13.043875 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:37007
--webserver_interface=127.1.81.254
--webserver_port=42875
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:37007
--ranger_config_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49923/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.81.212:49923/kms with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:13.163836 20827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.164088 20827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.164145 20827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.168011 20827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:13.168066 20827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.168092 20827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.168123 20827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:13.168150 20827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:13.173316 20827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.81.212:49923/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:37007
--ranger_config_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:37007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=42875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:13.174216 20827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.175129 20827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.183123 20836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.183109 20839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.183099 20837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.183560 20827 server_base.cc:1034] running on GCE node
I20260809 02:23:13.184144 20827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.185153 20827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.186311 20827 hybrid_clock.cc:648] HybridClock initialized: now 1786242193186286 us; error 41 us; skew 500 ppm
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:13.188990 20827 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:23:13.189875 20827 webserver.cc:460] Webserver started at http://127.1.81.254:42875/ using document root <none> and password file <none>
I20260809 02:23:13.190375 20827 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.190441 20827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:13.230942 20827 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:23:13.233736 20852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.235317 20827 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:23:13.235459 20827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "4fe665d4ebf249c7bf0344d6668ad324"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-jlzn"
server_key: "2ce3397d8968e83836ce5ae25e1aea80"
server_key_iv: "8dc448073b4654df4010b04686cb9645"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:13.236202 20827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.252949 20827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.255872 20827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.256047 20827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.263406 20827 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:37007
I20260809 02:23:13.263482 20924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:37007 every 8 connection(s)
I20260809 02:23:13.264443 20827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:13.268700 20927 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:23:13.270298 20927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Bootstrap starting.
I20260809 02:23:13.272835 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 20827
I20260809 02:23:13.273356 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:40683
--local_ip_for_outbound_sockets=127.1.81.193
--tserver_master_addrs=127.1.81.254:37007
--webserver_port=46797
--webserver_interface=127.1.81.193
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.81.212:49923/kms with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:13.286741 20927 log.cc:824] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:13.293071 20927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:23:13.293412 20927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Bootstrap complete.
I20260809 02:23:13.297298 20927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } }
I20260809 02:23:13.297672 20927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe665d4ebf249c7bf0344d6668ad324, State: Initialized, Role: FOLLOWER
I20260809 02:23:13.298213 20927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } }
I20260809 02:23:13.298360 20927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:13.298448 20927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:13.298552 20927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:23:13.300549 20927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } }
I20260809 02:23:13.300864 20927 leader_election.cc:302] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe665d4ebf249c7bf0344d6668ad324; no voters:
I20260809 02:23:13.301148 20927 leader_election.cc:288] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:23:13.301236 20932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:23:13.301661 20932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [term 2 LEADER]: Becoming Leader. State: Replica: 4fe665d4ebf249c7bf0344d6668ad324, State: Running, Role: LEADER
I20260809 02:23:13.301990 20932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } }
I20260809 02:23:13.302603 20927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:13.302942 20932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4fe665d4ebf249c7bf0344d6668ad324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } } }
I20260809 02:23:13.303128 20932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:13.303372 20932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe665d4ebf249c7bf0344d6668ad324. Latest consensus state: current_term: 2 leader_uuid: "4fe665d4ebf249c7bf0344d6668ad324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe665d4ebf249c7bf0344d6668ad324" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37007 } } }
I20260809 02:23:13.303519 20932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:13.303882 20937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:13.307041 20937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:13.307636 20927 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:23:13.307920 20937 catalog_manager.cc:1259] Loaded cluster ID: ab2af7a4d78b43329d8fc09c838a1426
I20260809 02:23:13.308127 20937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:13.310504 20937 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:13.311218 20937 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Loaded TSK: 0
I20260809 02:23:13.312498 20937 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:23:13.429740 20929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.430563 20929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.430734 20929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.436703 20929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.436864 20929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.436995 20929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:23:13.444538 20929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.81.212:49923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:40683
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=46797
--tserver_master_addrs=127.1.81.254:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:13.445966 20929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.447291 20929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.460278 20983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.460672 20980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.460778 20987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.461083 20929 server_base.cc:1034] running on GCE node
I20260809 02:23:13.461540 20929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.462232 20929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.463404 20929 hybrid_clock.cc:648] HybridClock initialized: now 1786242193463376 us; error 42 us; skew 500 ppm
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:13.466789 20929 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:23:13.467756 20929 webserver.cc:460] Webserver started at http://127.1.81.193:46797/ using document root <none> and password file <none>
I20260809 02:23:13.468427 20929 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.468523 20929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:13.489141 20929 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.000s
I20260809 02:23:13.492259 20995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.493738 20929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:23:13.493865 20929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "5eb9acc42f90ae731f3c2df3bafd0925"
server_key_iv: "bcc9230942d4e8a5912cbf90e06be33b"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:13.494529 20929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.524905 20929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.528339 20929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.528529 20929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.529184 20929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:13.530181 20929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:13.530244 20929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.530294 20929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:13.530320 20929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.546279 20929 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:40683
I20260809 02:23:13.547531 20929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:13.548143 21154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:40683 every 8 connection(s)
I20260809 02:23:13.556111 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 20929
I20260809 02:23:13.556582 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:42077
--local_ip_for_outbound_sockets=127.1.81.194
--tserver_master_addrs=127.1.81.254:37007
--webserver_port=45325
--webserver_interface=127.1.81.194
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.81.212:49923/kms with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:13.576694 21159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.550682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37007 (local address 127.1.81.193:38847)
0809 02:23:13.552101 (+ 1419us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.552156 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.553147 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.562710 (+ 9563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.562720 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.563070 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:13.563702 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.563724 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.565653 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.565657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.566963 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.566975 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.567997 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.568001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.568200 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.568855 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:13.568874 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:13.570616 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:13.573098 (+ 2482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.573104 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.573117 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.573451 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.573900 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.573903 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.573905 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.574085 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.574846 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:13.574852 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:13.575140 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.575337 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.575662 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1191,"thread_start_us":147,"threads_started":1}
I20260809 02:23:13.579052 21160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.552158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:38847 (local address 127.1.81.254:37007)
0809 02:23:13.561338 (+ 9180us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.561364 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.561411 (+ 47us) server_negotiation.cc:407] Connection header received
0809 02:23:13.561707 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.561723 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.562180 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.562582 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.563962 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.565487 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.567092 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.567788 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.568575 (+ 787us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.570853 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.570860 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.570876 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:13.570908 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.572955 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.573602 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.573608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.573614 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.573781 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.574211 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.574214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.574215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.574705 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.577717 (+ 3012us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.577878 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.578163 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9010,"thread_start_us":118,"threads_started":1}
I20260809 02:23:13.581485 21155 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37007
I20260809 02:23:13.581712 21155 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.582175 21155 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
W20260809 02:23:13.584209 21155 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:37007 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:23:13.584332 21155 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.584498 21155 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:13.585405 21155 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.585577 21155 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
W20260809 02:23:13.586411 21155 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:23:13.695638 21162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.695987 21162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.696118 21162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.701411 21162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.701469 21162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.701545 21162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:23:13.707214 21162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.81.212:49923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:42077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=45325
--tserver_master_addrs=127.1.81.254:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:13.708343 21162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.709563 21162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.721686 21177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.721714 21173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.721828 21162 server_base.cc:1034] running on GCE node
W20260809 02:23:13.722137 21170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.722589 21162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.723338 21162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.724535 21162 hybrid_clock.cc:648] HybridClock initialized: now 1786242193724508 us; error 33 us; skew 500 ppm
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:13.730952 21162 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:23:13.732101 21162 webserver.cc:460] Webserver started at http://127.1.81.194:45325/ using document root <none> and password file <none>
I20260809 02:23:13.732843 21162 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.732961 21162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:13.759168 21162 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:23:13.761674 21187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.763006 21162 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:23:13.763111 21162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "6884109be588440597d72fa8ed1f478c"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "fcdad8b477d41676a72969160c0d26ea"
server_key_iv: "37e84451540a5400372573ae765b12f7"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:13.763644 21162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.775621 21162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.778270 21162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.778430 21162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.778959 21162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:13.779824 21162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:13.779881 21162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.779935 21162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:13.779958 21162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.790603 21162 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:42077
I20260809 02:23:13.790657 21356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:42077 every 8 connection(s)
I20260809 02:23:13.792196 21162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:13.795565 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 21162
I20260809 02:23:13.796126 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.81.212:49923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:43271
--local_ip_for_outbound_sockets=127.1.81.195
--tserver_master_addrs=127.1.81.254:37007
--webserver_port=43369
--webserver_interface=127.1.81.195
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.81.212:49923/kms with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:13.812274 21160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.794364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:51773 (local address 127.1.81.254:37007)
0809 02:23:13.794493 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.794497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.796118 (+ 1621us) server_negotiation.cc:407] Connection header received
0809 02:23:13.797252 (+ 1134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.797256 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.797313 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.797405 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.798769 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.799610 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.801505 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.801903 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.801989 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.808167 (+ 6178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.808171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.808174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:13.808205 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.809882 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.810498 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.810502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.810504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.810600 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.810977 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.810980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.810982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.811206 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.811287 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.811966 (+ 679us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.812108 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:23:13.813971 21359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.794842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37007 (local address 127.1.81.194:51773)
0809 02:23:13.795947 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.796005 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.797019 (+ 1014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.797604 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.797613 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.797942 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:13.798585 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.798607 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.799876 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.799880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.801350 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.801361 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.802231 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.802236 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.802437 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.803041 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:13.803061 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:13.807966 (+ 4905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:13.810011 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.810017 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.810031 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.810371 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.810707 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.810710 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.810712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.810873 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.811352 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:13.811358 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:13.811658 (+ 300us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.812754 (+ 1096us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.813055 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":136,"threads_started":1}
I20260809 02:23:13.815342 21357 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37007
I20260809 02:23:13.815583 21357 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.816170 21357 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
W20260809 02:23:13.817730 21357 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:37007 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:23:13.817852 21357 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.818005 21357 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:13.818866 21357 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.819032 21357 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
W20260809 02:23:13.819780 21357 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:23:13.933868 21360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.934098 21360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.934154 21360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.938180 21360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.938237 21360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.938311 21360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:23:13.944561 21360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.81.212:49923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:43271
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=43369
--tserver_master_addrs=127.1.81.254:37007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:13.945889 21360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.947109 21360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.958720 21367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.958714 21366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.958952 21360 server_base.cc:1034] running on GCE node
W20260809 02:23:13.959132 21371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.959611 21360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.960374 21360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.961591 21360 hybrid_clock.cc:648] HybridClock initialized: now 1786242193961573 us; error 29 us; skew 500 ppm
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:13.965762 21360 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:23:13.966833 21360 webserver.cc:460] Webserver started at http://127.1.81.195:43369/ using document root <none> and password file <none>
I20260809 02:23:13.967525 21360 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.967648 21360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:23:13 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:13.995079 21360 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260809 02:23:14.001103 21381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.002602 21360 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260809 02:23:14.002737 21360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-jlzn"
server_key: "a7cadd38d8d66157a190b6a7be8acddc"
server_key_iv: "27c8baa03dce5f7a909a3da0218cba4d"
server_key_version: "kuduclusterkey@0"
I20260809 02:23:14.003410 21360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:14.021024 21360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:14.023758 21360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:14.023953 21360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:14.024524 21360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:14.025388 21360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:14.025439 21360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.025490 21360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:14.025520 21360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.036764 21360 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:43271
I20260809 02:23:14.036795 21551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:43271 every 8 connection(s)
I20260809 02:23:14.038019 21360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:14.045079 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 21360
Aug 09 02:23:14 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:14.054805 21160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.040348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:50419 (local address 127.1.81.254:37007)
0809 02:23:14.040469 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.040474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.042704 (+ 2230us) server_negotiation.cc:407] Connection header received
0809 02:23:14.043625 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.043629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.043690 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.043762 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:14.045121 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.045832 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.047589 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.047838 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.047931 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.050713 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:14.050717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:14.050719 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:14.050746 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:14.052489 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:14.053098 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:14.053102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:14.053103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:14.053198 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:14.053601 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:14.053604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:14.053606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:14.053814 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:14.053884 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.054505 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.054644 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:23:14.055658 21556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.040745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37007 (local address 127.1.81.195:50419)
0809 02:23:14.042563 (+ 1818us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.042602 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:14.043420 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:14.043965 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:14.043971 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:14.044308 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:14.044905 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.044926 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.046197 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.046201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.047475 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.047484 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.047974 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.047979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.048192 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.048803 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:14.048824 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:14.050523 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:14.052631 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:14.052636 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:14.052650 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:14.052965 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:14.053315 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:14.053318 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:14.053320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:14.053490 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:14.053961 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:14.053967 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:14.054250 (+ 283us) client_negotiation.cc:769] Sending connection context
0809 02:23:14.054437 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 02:23:14.054707 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1644,"thread_start_us":248,"threads_started":1}
I20260809 02:23:14.056744 21552 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37007
I20260809 02:23:14.056962 21552 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:14.057396 21552 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
W20260809 02:23:14.058921 21552 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:37007 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:23:14.059029 21552 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:14.059190 21552 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:14.060078 21552 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:14.060258 21552 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
W20260809 02:23:14.061335 21552 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:23:14.065264 21559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.045967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56104 (local address 127.1.81.254:37007)
0809 02:23:14.046245 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.046255 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.046271 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:23:14.046310 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.046313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.046360 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.046459 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:14.048135 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.048914 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.054331 (+ 5417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.056577 (+ 2246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.056692 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.060483 (+ 3791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:14.060487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:14.060489 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:14.060514 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:14.062280 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:14.062686 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:14.062690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:14.062692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:14.062783 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:14.063014 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:14.063017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:14.063019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:14.063227 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:14.063425 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.064974 (+ 1549us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.065096 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":82,"threads_started":1}
Aug 09 02:23:14 dist-test-slave-jlzn krb5kdc[19349](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242194, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:14.586652 21155 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:14.586935 21155 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:14.587988 20877 ts_manager.cc:194] Registered new tserver with Master: 54a0f8a4fd9249e8a4cefb6f4b1ca821 (127.1.81.193:40683)
I20260809 02:23:14.589303 20877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:38847
I20260809 02:23:14.820000 21357 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:14.820295 21357 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:14.821044 20877 ts_manager.cc:194] Registered new tserver with Master: 6884109be588440597d72fa8ed1f478c (127.1.81.194:42077)
I20260809 02:23:14.822091 20877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:51773
Aug 09 02:23:14 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242194, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:15.061554 21552 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:15.061842 21552 heartbeater.cc:511] Master 127.1.81.254:37007 requested a full tablet report, sending...
I20260809 02:23:15.062548 20877 ts_manager.cc:194] Registered new tserver with Master: dff4c664a1604f5dbd67b4f8a5b9c48f (127.1.81.195:43271)
I20260809 02:23:15.063129 20877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:50419
I20260809 02:23:15.064997 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:15.075042 21589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.066529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56112 (local address 127.1.81.254:37007)
0809 02:23:15.066773 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:15.066778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:15.066979 (+ 201us) server_negotiation.cc:407] Connection header received
0809 02:23:15.067083 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:15.067086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:15.067131 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:15.067211 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:15.067866 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.068466 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.069286 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.069510 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.069597 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.071138 (+ 1541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:15.071152 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:15.071155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:15.071181 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:15.072910 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:15.073406 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:15.073409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:15.073411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:15.073502 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:15.073810 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:15.073813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:15.073815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:15.074015 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:15.074153 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:15.074750 (+ 597us) server_negotiation.cc:299] Negotiation successful
0809 02:23:15.074872 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":87,"threads_started":1}
I20260809 02:23:15.078886 20877 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:15.083066 20877 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 09 02:23:15 dist-test-slave-jlzn krb5kdc[19349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242194, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for HTTP/127.1.81.212@KRBTEST.COM
I20260809 02:23:15.103539 21601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.096582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45246 (local address 127.1.81.194:42077)
0809 02:23:15.097356 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:15.097362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:15.097386 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:23:15.097461 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:15.097467 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:15.097666 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:15.097806 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:15.098255 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.099047 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.101653 (+ 2606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.102465 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.102562 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.102755 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:15.103291 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 02:23:15.103396 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":97,"threads_started":1}
I20260809 02:23:15.104616 21595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.096080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:42077 (local address 127.0.0.1:45246)
0809 02:23:15.097046 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:15.097058 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:15.097135 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:15.097965 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:15.097971 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:15.097996 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:15.098112 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.098120 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.099206 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.099209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.101507 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.101519 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.102811 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.102815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.102912 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.102950 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 02:23:15.103048 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 02:23:15.103168 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"thread_start_us":76,"threads_started":1}
I20260809 02:23:15.106355 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.096397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:43271 (local address 127.0.0.1:33104)
0809 02:23:15.099432 (+ 3035us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:15.099444 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:15.099534 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:15.100195 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:15.100198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:15.100213 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:15.100297 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.100303 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.101660 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.101663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.102730 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.102741 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.105983 (+ 3242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.105987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.106071 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.106094 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:23:15.106164 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:23:15.106225 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2980,"thread_start_us":82,"threads_started":1}
I20260809 02:23:15.107774 21228 tablet_service.cc:1467] Processing CreateTablet for tablet 774b9d352b014210b5964a3d9e5afbe4 (DEFAULT_TABLE table=test-table [id=e45c2921aed04c17bb997c31dd67408f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:15.108666 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.096928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33104 (local address 127.1.81.195:43271)
0809 02:23:15.099305 (+ 2377us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:15.099311 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:15.099640 (+ 329us) server_negotiation.cc:407] Connection header received
0809 02:23:15.099717 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:15.099723 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:15.099922 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:15.100062 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:15.100423 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.101541 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.104949 (+ 3408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.105704 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.105800 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.105921 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:15.108427 (+ 2506us) server_negotiation.cc:299] Negotiation successful
0809 02:23:15.108521 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2276,"thread_start_us":104,"threads_started":1}
I20260809 02:23:15.108968 21228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 774b9d352b014210b5964a3d9e5afbe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:15.110011 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.095677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:40683 (local address 127.0.0.1:56664)
0809 02:23:15.096666 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:15.096714 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:15.096835 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:15.103392 (+ 6557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:15.103395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:15.103411 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:15.103490 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.103495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.106871 (+ 3376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.106875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.107947 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.107958 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.109665 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.109669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.109763 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.109787 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:23:15.109835 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 02:23:15.109893 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"thread_start_us":87,"threads_started":1}
I20260809 02:23:15.110805 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.097251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56664 (local address 127.1.81.193:40683)
0809 02:23:15.102983 (+ 5732us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:15.102990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:15.103011 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:23:15.103081 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:15.103086 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:15.103253 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:15.103643 (+ 390us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:15.103784 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.106759 (+ 2975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.108095 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.109418 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.110395 (+ 977us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.110526 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:15.110590 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 02:23:15.110675 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5633,"thread_start_us":108,"threads_started":1}
I20260809 02:23:15.112352 21426 tablet_service.cc:1467] Processing CreateTablet for tablet 774b9d352b014210b5964a3d9e5afbe4 (DEFAULT_TABLE table=test-table [id=e45c2921aed04c17bb997c31dd67408f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:15.113366 21426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 774b9d352b014210b5964a3d9e5afbe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:15.114223 21067 tablet_service.cc:1467] Processing CreateTablet for tablet 774b9d352b014210b5964a3d9e5afbe4 (DEFAULT_TABLE table=test-table [id=e45c2921aed04c17bb997c31dd67408f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:15.115127 21067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 774b9d352b014210b5964a3d9e5afbe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:15.120638 21605 tablet_bootstrap.cc:492] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Bootstrap starting.
I20260809 02:23:15.122947 21605 tablet_bootstrap.cc:654] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:15.123350 21606 tablet_bootstrap.cc:492] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821: Bootstrap starting.
I20260809 02:23:15.123845 21605 log.cc:824] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:15.125406 21606 tablet_bootstrap.cc:654] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:15.125980 21605 tablet_bootstrap.cc:492] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: No bootstrap required, opened a new log
I20260809 02:23:15.126180 21605 ts_tablet_manager.cc:1397] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:23:15.126199 21606 log.cc:824] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:15.129355 21606 tablet_bootstrap.cc:492] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821: No bootstrap required, opened a new log
I20260809 02:23:15.129531 21606 ts_tablet_manager.cc:1397] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260809 02:23:15.130232 21605 raft_consensus.cc:348] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.130476 21605 raft_consensus.cc:374] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:15.130533 21605 raft_consensus.cc:729] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6884109be588440597d72fa8ed1f478c, State: Initialized, Role: FOLLOWER
I20260809 02:23:15.130962 21605 consensus_queue.cc:260] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.132081 21605 ts_tablet_manager.cc:1428] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:23:15.133144 21606 raft_consensus.cc:348] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.133325 21357 heartbeater.cc:503] Master 127.1.81.254:37007 was elected leader, sending a full tablet report...
I20260809 02:23:15.133407 21606 raft_consensus.cc:374] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:15.133483 21606 raft_consensus.cc:729] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a0f8a4fd9249e8a4cefb6f4b1ca821, State: Initialized, Role: FOLLOWER
I20260809 02:23:15.133940 21606 consensus_queue.cc:260] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.135696 21606 ts_tablet_manager.cc:1428] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:23:15.136075 21155 heartbeater.cc:503] Master 127.1.81.254:37007 was elected leader, sending a full tablet report...
I20260809 02:23:15.139916 21614 tablet_bootstrap.cc:492] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Bootstrap starting.
I20260809 02:23:15.142431 21614 tablet_bootstrap.cc:654] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:15.143286 21614 log.cc:824] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:15.145833 21614 tablet_bootstrap.cc:492] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: No bootstrap required, opened a new log
I20260809 02:23:15.146010 21614 ts_tablet_manager.cc:1397] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:23:15.149490 21614 raft_consensus.cc:348] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.149802 21614 raft_consensus.cc:374] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:15.149883 21614 raft_consensus.cc:729] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dff4c664a1604f5dbd67b4f8a5b9c48f, State: Initialized, Role: FOLLOWER
I20260809 02:23:15.150314 21614 consensus_queue.cc:260] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.151314 21614 ts_tablet_manager.cc:1428] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:23:15.151684 21552 heartbeater.cc:503] Master 127.1.81.254:37007 was elected leader, sending a full tablet report...
W20260809 02:23:15.290158 21553 tablet.cc:2369] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:23:15.294041 21358 tablet.cc:2369] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:23:15.299850 21158 tablet.cc:2369] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:15.382778 21611 raft_consensus.cc:482] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:15.382989 21611 raft_consensus.cc:504] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.384294 21611 leader_election.cc:288] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54a0f8a4fd9249e8a4cefb6f4b1ca821 (127.1.81.193:40683), dff4c664a1604f5dbd67b4f8a5b9c48f (127.1.81.195:43271)
I20260809 02:23:15.388746 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.384716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:54983 (local address 127.1.81.193:40683)
0809 02:23:15.384851 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:15.384855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:15.384902 (+ 47us) server_negotiation.cc:407] Connection header received
0809 02:23:15.385072 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:15.385076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:15.385132 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:15.385197 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:15.385697 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.386511 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.387745 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.388196 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.388323 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.388376 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:15.388543 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 02:23:15.388613 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:23:15.388765 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.384500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:40683 (local address 127.1.81.194:54983)
0809 02:23:15.384814 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:15.384829 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:15.384921 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:15.385366 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:15.385369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:15.385392 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:15.385540 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.385547 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.386634 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.386637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.387603 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.387614 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.388311 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.388315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.388420 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.388449 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 02:23:15.388520 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:23:15.388591 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":66,"thread_start_us":130,"threads_started":1}
I20260809 02:23:15.389475 21629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.384914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:43271 (local address 127.1.81.194:58691)
0809 02:23:15.385549 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:15.385562 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:15.385664 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:15.385916 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:15.385918 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:15.385937 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:15.386049 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.386054 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.386820 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.386824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.388089 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:15.388103 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.389073 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.389076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:15.389174 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.389198 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:23:15.389275 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:23:15.389342 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":100,"threads_started":1}
I20260809 02:23:15.389478 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.385322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:58691 (local address 127.1.81.195:43271)
0809 02:23:15.385476 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:15.385481 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:15.385629 (+ 148us) server_negotiation.cc:407] Connection header received
0809 02:23:15.385779 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:15.385782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:15.385827 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:15.385888 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:15.386166 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.386693 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.388232 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.388744 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.388855 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.388903 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:15.389305 (+ 402us) server_negotiation.cc:299] Negotiation successful
0809 02:23:15.389379 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:23:15.389506 21078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "774b9d352b014210b5964a3d9e5afbe4" candidate_uuid: "6884109be588440597d72fa8ed1f478c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" is_pre_election: true
I20260809 02:23:15.389815 21078 raft_consensus.cc:2454] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6884109be588440597d72fa8ed1f478c in term 0.
I20260809 02:23:15.390209 21478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "774b9d352b014210b5964a3d9e5afbe4" candidate_uuid: "6884109be588440597d72fa8ed1f478c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" is_pre_election: true
I20260809 02:23:15.390281 21192 leader_election.cc:302] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a0f8a4fd9249e8a4cefb6f4b1ca821, 6884109be588440597d72fa8ed1f478c; no voters:
I20260809 02:23:15.390480 21478 raft_consensus.cc:2454] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6884109be588440597d72fa8ed1f478c in term 0.
I20260809 02:23:15.390580 21611 raft_consensus.cc:2781] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:15.390686 21611 raft_consensus.cc:482] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:15.390733 21611 raft_consensus.cc:3037] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:15.391790 21611 raft_consensus.cc:504] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.392138 21611 leader_election.cc:288] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [CANDIDATE]: Term 1 election: Requested vote from peers 54a0f8a4fd9249e8a4cefb6f4b1ca821 (127.1.81.193:40683), dff4c664a1604f5dbd67b4f8a5b9c48f (127.1.81.195:43271)
I20260809 02:23:15.392504 21078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "774b9d352b014210b5964a3d9e5afbe4" candidate_uuid: "6884109be588440597d72fa8ed1f478c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821"
I20260809 02:23:15.392565 21478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "774b9d352b014210b5964a3d9e5afbe4" candidate_uuid: "6884109be588440597d72fa8ed1f478c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f"
I20260809 02:23:15.392634 21078 raft_consensus.cc:3037] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:15.392675 21478 raft_consensus.cc:3037] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:15.393872 21478 raft_consensus.cc:2454] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6884109be588440597d72fa8ed1f478c in term 1.
I20260809 02:23:15.393939 21078 raft_consensus.cc:2454] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6884109be588440597d72fa8ed1f478c in term 1.
I20260809 02:23:15.394222 21192 leader_election.cc:302] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a0f8a4fd9249e8a4cefb6f4b1ca821, 6884109be588440597d72fa8ed1f478c; no voters:
I20260809 02:23:15.394388 21611 raft_consensus.cc:2781] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:15.394590 21611 raft_consensus.cc:686] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 1 LEADER]: Becoming Leader. State: Replica: 6884109be588440597d72fa8ed1f478c, State: Running, Role: LEADER
I20260809 02:23:15.394905 21611 consensus_queue.cc:237] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } }
I20260809 02:23:15.398048 20877 catalog_manager.cc:5495] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6884109be588440597d72fa8ed1f478c (127.1.81.194). New cstate: current_term: 1 leader_uuid: "6884109be588440597d72fa8ed1f478c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6884109be588440597d72fa8ed1f478c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 42077 } health_report { overall_health: HEALTHY } } }
I20260809 02:23:15.463896 21601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.460426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45262 (local address 127.1.81.194:42077)
0809 02:23:15.460550 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:15.460554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:15.460569 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:23:15.460683 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:15.460686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:15.460743 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:15.460831 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:15.461093 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.461584 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.462442 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.462660 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.462762 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.463070 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:15.463475 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:15.463580 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:15.463663 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 02:23:15.463720 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:23:15.469717 21478 raft_consensus.cc:1261] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 1 FOLLOWER]: Refusing update from remote peer 6884109be588440597d72fa8ed1f478c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:15.469717 21078 raft_consensus.cc:1261] T 774b9d352b014210b5964a3d9e5afbe4 P 54a0f8a4fd9249e8a4cefb6f4b1ca821 [term 1 FOLLOWER]: Refusing update from remote peer 6884109be588440597d72fa8ed1f478c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:15.470424 21611 consensus_queue.cc:1035] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [LEADER]: Connected to new peer: Peer: permanent_uuid: "54a0f8a4fd9249e8a4cefb6f4b1ca821" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:15.470688 21630 consensus_queue.cc:1035] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dff4c664a1604f5dbd67b4f8a5b9c48f" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:15.479521 21634 mvcc.cc:205] Tried to move back new op lower bound from 7316448032636518400 to 7316448032339623936. Current Snapshot: MvccSnapshot[applied={T|T < 7316448032636518400}]
I20260809 02:23:15.490181 20877 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:15.490499 20877 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:15.493171 20877 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fe665d4ebf249c7bf0344d6668ad324: Sending DeleteTablet for 3 replicas of tablet 774b9d352b014210b5964a3d9e5afbe4
I20260809 02:23:15.493872 21228 tablet_service.cc:1514] Processing DeleteTablet for tablet 774b9d352b014210b5964a3d9e5afbe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:15 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:45246
I20260809 02:23:15.494143 21426 tablet_service.cc:1514] Processing DeleteTablet for tablet 774b9d352b014210b5964a3d9e5afbe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:15 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:33104
I20260809 02:23:15.494170 21067 tablet_service.cc:1514] Processing DeleteTablet for tablet 774b9d352b014210b5964a3d9e5afbe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:15 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:56664
I20260809 02:23:15.494661 21648 tablet_replica.cc:330] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: stopping tablet replica
I20260809 02:23:15.495004 21649 tablet_replica.cc:330] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: stopping tablet replica
I20260809 02:23:15.495009 21648 raft_consensus.cc:2229] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:23:15.495350 21649 raft_consensus.cc:2229] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:15.495371 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 20929
I20260809 02:23:15.495389 21648 raft_consensus.cc:2258] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:15.498584 21649 raft_consensus.cc:2258] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:15.499205 21648 ts_tablet_manager.cc:1905] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:15.500072 21649 ts_tablet_manager.cc:1905] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:15.501986 21648 ts_tablet_manager.cc:1918] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:15.502153 21648 log.cc:1196] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/774b9d352b014210b5964a3d9e5afbe4
I20260809 02:23:15.502513 21648 ts_tablet_manager.cc:1939] T 774b9d352b014210b5964a3d9e5afbe4 P 6884109be588440597d72fa8ed1f478c: Deleting consensus metadata
I20260809 02:23:15.502710 21649 ts_tablet_manager.cc:1918] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:15.502871 21649 log.cc:1196] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/774b9d352b014210b5964a3d9e5afbe4
I20260809 02:23:15.503285 21649 ts_tablet_manager.cc:1939] T 774b9d352b014210b5964a3d9e5afbe4 P dff4c664a1604f5dbd67b4f8a5b9c48f: Deleting consensus metadata
I20260809 02:23:15.503825 20855 catalog_manager.cc:4841] TS 6884109be588440597d72fa8ed1f478c (127.1.81.194:42077): tablet 774b9d352b014210b5964a3d9e5afbe4 (table test-table [id=e45c2921aed04c17bb997c31dd67408f]) successfully deleted
I20260809 02:23:15.504622 20854 catalog_manager.cc:4841] TS dff4c664a1604f5dbd67b4f8a5b9c48f (127.1.81.195:43271): tablet 774b9d352b014210b5964a3d9e5afbe4 (table test-table [id=e45c2921aed04c17bb997c31dd67408f]) successfully deleted
W20260809 02:23:15.507566 20854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:40683 (error 108)
I20260809 02:23:15.508523 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.508247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:40683 (local address 127.0.0.1:56680)
0809 02:23:15.508375 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:15.508441 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 02:23:15.508669 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 21162
W20260809 02:23:15.513329 20854 catalog_manager.cc:4584] TS 54a0f8a4fd9249e8a4cefb6f4b1ca821 (127.1.81.193:40683): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 774b9d352b014210b5964a3d9e5afbe4: Network error: Client connection negotiation failed: client connection to 127.1.81.193:40683: connect: Connection refused (error 111)
I20260809 02:23:15.517491 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 21360
I20260809 02:23:15.527938 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 20827
I20260809 02:23:15.539997 1351 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 02:23:15.883612 1351 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 02:23:15.883729 1351 mini_ranger.cc:66] Stopping Ranger...
I20260809 02:23:16.228050 1351 mini_ranger.cc:68] Stopped Ranger
2026-08-09 02:23:16.228 UTC [19396] LOG: received smart shutdown request
2026-08-09 02:23:16.232 UTC [19396] LOG: background worker "logical replication launcher" (PID 19406) exited with exit code 1
2026-08-09 02:23:16.232 UTC [19400] LOG: shutting down
2026-08-09 02:23:16.360 UTC [19396] LOG: database system is shut down
2026-08-09T02:23:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (46648 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:16 dist-test-slave-jlzn krb5kdc[21666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:16 dist-test-slave-jlzn krb5kdc[21666](info): set up 2 sockets
Aug 09 02:23:16 dist-test-slave-jlzn krb5kdc[21666](info): commencing operation
krb5kdc: starting...
W20260809 02:23:17.585695 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:23:17 dist-test-slave-jlzn krb5kdc[21666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:23:17.696617 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:39293
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:39293,127.1.81.253:34065,127.1.81.252:38021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:17.808104 21683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:17.808323 21683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:17.808359 21683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:17.812193 21683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:17.812240 21683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:17.812258 21683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:17.812278 21683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:17.812292 21683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:17.817231 21683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:39293,127.1.81.253:34065,127.1.81.252:38021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:39293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:17.818063 21683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:17.818915 21683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:17.826635 21692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:17.826671 21695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:17.826730 21683 server_base.cc:1034] running on GCE node
W20260809 02:23:17.826635 21693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:17.827420 21683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:17.828414 21683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:17.829572 21683 hybrid_clock.cc:648] HybridClock initialized: now 1786242197829545 us; error 36 us; skew 500 ppm
Aug 09 02:23:17 dist-test-slave-jlzn krb5kdc[21666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242197, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:17.832166 21683 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:23:17.832991 21683 webserver.cc:460] Webserver started at http://127.1.81.254:36249/ using document root <none> and password file <none>
I20260809 02:23:17.833475 21683 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:17.833539 21683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:17.833717 21683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:17.835558 21683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "150d842a91ba4a1992a1d474a8ee16d0"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-jlzn"
server_key: "0a59a25ef0377cdb6d1bc51511da51cb"
server_key_iv: "13217022d2bc451e5f988437c08161aa"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.836098 21683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "150d842a91ba4a1992a1d474a8ee16d0"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-jlzn"
server_key: "0a59a25ef0377cdb6d1bc51511da51cb"
server_key_iv: "13217022d2bc451e5f988437c08161aa"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.839468 21683 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:23:17.841667 21706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:17.842777 21683 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:17.842888 21683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "150d842a91ba4a1992a1d474a8ee16d0"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-jlzn"
server_key: "0a59a25ef0377cdb6d1bc51511da51cb"
server_key_iv: "13217022d2bc451e5f988437c08161aa"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.842975 21683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:17.860373 21683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:17.862777 21683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:17.862932 21683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:17.869494 21683 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:39293
I20260809 02:23:17.869515 21778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:39293 every 8 connection(s)
I20260809 02:23:17.870296 21683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:17.872814 21780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:17.873389 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 21683
I20260809 02:23:17.873510 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:23:17.873816 1351 external_mini_cluster.cc:1428] Setting key 20738874da1d56f14731ef3f3bf07be1
I20260809 02:23:17.876864 21780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.81.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.253@KRBTEST.COM" created.
Aug 09 02:23:17 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242197, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:17.890664 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.879003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:39293 (local address 127.0.0.1:49168)
0809 02:23:17.879444 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.879484 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:17.880335 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:17.880947 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:17.880952 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:17.881362 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:17.881580 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.881594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.882655 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.882659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.883383 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.883396 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.884050 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.884053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.884138 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.884632 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:17.884650 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:17.886176 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:17.888113 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:17.888124 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:17.888133 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:17.888357 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:17.888705 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:17.888707 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:17.888709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:17.888803 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:17.889479 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:17.889483 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:17.889601 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 02:23:17.889728 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 02:23:17.889950 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":116,"threads_started":1}
I20260809 02:23:17.890676 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.879924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49168 (local address 127.1.81.254:39293)
0809 02:23:17.880205 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.880216 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.880259 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:23:17.880594 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.880598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.880770 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.880931 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:17.881719 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.882546 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.883505 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.883929 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.884057 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.886327 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:17.886334 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:17.886346 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:17.886372 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:17.887987 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:17.888467 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:17.888473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:17.888475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:17.888605 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:17.888890 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:17.888894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:17.888895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:17.889364 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:17.889504 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.889844 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.890047 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":183,"thread_start_us":89,"threads_started":1}
I20260809 02:23:17.893225 21780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:17.893864 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.893630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:57972)
0809 02:23:17.893736 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.893811 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 02:23:17.894066 21708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
I20260809 02:23:17.894832 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.894621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:57988)
0809 02:23:17.894723 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.894775 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 02:23:17.894974 21780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:34065: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab.
Entry for principal kudu/127.1.81.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab.
I20260809 02:23:17.899976 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.253:34065
--webserver_interface=127.1.81.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab
--principal=kudu/127.1.81.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:39293,127.1.81.253:34065,127.1.81.252:38021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:17.944187 21780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } attempt: 1
I20260809 02:23:17.944887 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.944635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:58004)
0809 02:23:17.944766 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.944820 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 02:23:17.945520 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.945332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:58016)
0809 02:23:17.945423 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.945466 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 02:23:17.945628 21780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:34065: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
W20260809 02:23:18.005283 21794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:18.005492 21794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:18.005529 21794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:18.009366 21794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:18.009413 21794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:18.009430 21794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:18.009449 21794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:18.009469 21794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:18.013757 21780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } attempt: 2
I20260809 02:23:18.014360 21794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:39293,127.1.81.253:34065,127.1.81.252:38021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab
--principal=kudu/127.1.81.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.253:34065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.81.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:18.014417 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.014173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:58030)
0809 02:23:18.014299 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.014353 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 02:23:18.015182 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.014923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:58044)
0809 02:23:18.015050 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.015110 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 02:23:18.015288 21794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260809 02:23:18.015324 21780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:34065: Network error: Client connection negotiation failed: client connection to 127.1.81.253:34065: connect: Connection refused (error 111)
I20260809 02:23:18.016206 21794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:18.023649 21799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:18.023656 21804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:18.023630 21800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:18.023978 21794 server_base.cc:1034] running on GCE node
I20260809 02:23:18.024560 21794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:18.025537 21794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:18.026690 21794 hybrid_clock.cc:648] HybridClock initialized: now 1786242198026678 us; error 23 us; skew 500 ppm
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:18.029282 21794 init.cc:377] Logged in from keytab as kudu/127.1.81.253@KRBTEST.COM (short username kudu)
I20260809 02:23:18.030045 21794 webserver.cc:460] Webserver started at http://127.1.81.253:36499/ using document root <none> and password file <none>
I20260809 02:23:18.030525 21794 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:18.030591 21794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:18.030777 21794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:18.032647 21794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/data/instance:
uuid: "68515bba9c394895b03f47720d87f51b"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-jlzn"
server_key: "5cfd0cbbf5f182fcd67133ef359f02e3"
server_key_iv: "18fedfb7d9d25c654c940449449abb6b"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.033174 21794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/wal/instance:
uuid: "68515bba9c394895b03f47720d87f51b"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-jlzn"
server_key: "5cfd0cbbf5f182fcd67133ef359f02e3"
server_key_iv: "18fedfb7d9d25c654c940449449abb6b"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.036464 21794 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:23:18.038554 21819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:18.039660 21794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:23:18.039772 21794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/wal
uuid: "68515bba9c394895b03f47720d87f51b"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-jlzn"
server_key: "5cfd0cbbf5f182fcd67133ef359f02e3"
server_key_iv: "18fedfb7d9d25c654c940449449abb6b"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.039888 21794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:18.061513 21794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:18.064327 21794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:18.064496 21794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:18.070969 21794 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.253:34065
I20260809 02:23:18.071019 21914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.253:34065 every 8 connection(s)
I20260809 02:23:18.071834 21794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
I20260809 02:23:18.074311 21916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:18.074915 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 21794
I20260809 02:23:18.075028 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-1/wal/instance
I20260809 02:23:18.075287 1351 external_mini_cluster.cc:1428] Setting key 76d72691dfdba8d6fc5b19c51fb528c9
I20260809 02:23:18.077745 21916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.81.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.252@KRBTEST.COM" created.
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:18.092358 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.079540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49184 (local address 127.1.81.254:39293)
0809 02:23:18.079675 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.079680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.080575 (+ 895us) server_negotiation.cc:407] Connection header received
0809 02:23:18.081693 (+ 1118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.081696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.081746 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.081823 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.083216 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.083729 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.085205 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.085447 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.085544 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.088277 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.088280 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.088282 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.088306 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.090369 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.090838 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.090841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.090842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.090920 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.091237 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.091240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.091241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.091412 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.091496 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.092078 (+ 582us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.092202 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:23:18.093030 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.079906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:39293 (local address 127.0.0.1:49184)
0809 02:23:18.080410 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.080463 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:18.081438 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:18.082012 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:18.082021 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:18.082448 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:18.083081 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.083100 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.083874 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.083878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.085099 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.085110 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.085574 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.085578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.085724 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.086157 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:18.086173 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:18.088104 (+ 1931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:18.090473 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.090478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.090488 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.090724 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.091003 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.091006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.091007 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.091132 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.091512 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:18.091519 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:18.091789 (+ 270us) client_negotiation.cc:769] Sending connection context
0809 02:23:18.091983 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 02:23:18.092282 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":134,"threads_started":1}
I20260809 02:23:18.094276 21916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab.
Entry for principal kudu/127.1.81.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab.
I20260809 02:23:18.102054 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.252:38021
--webserver_interface=127.1.81.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab
--principal=kudu/127.1.81.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:36893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:39293,127.1.81.253:34065,127.1.81.252:38021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:18.102442 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.094707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:58052)
0809 02:23:18.094808 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.094822 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:18.094892 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:18.095440 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:18.095443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:18.095586 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:18.095663 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.095668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.096679 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.096683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.097236 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.097245 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.097815 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.097819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.097901 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.098291 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:18.098304 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:18.099452 (+ 1148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:18.101093 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.101096 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.101098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.101305 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.101572 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.101575 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.101577 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.101661 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.102046 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:18.102049 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:18.102131 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 02:23:18.102233 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:23:18.102340 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 02:23:18.102898 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.094834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58052 (local address 127.1.81.253:34065)
0809 02:23:18.095136 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.095146 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.095173 (+ 27us) server_negotiation.cc:407] Connection header received
0809 02:23:18.095203 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.095207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.095332 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.095439 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.095762 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.096566 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.097347 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.097714 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.097802 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.099575 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.099585 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.099594 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.099614 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.100998 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.101398 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.101404 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.101405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.101490 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.101737 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.101740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.101742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.101950 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.102062 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.102645 (+ 583us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.102773 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":136,"threads_started":1}
I20260809 02:23:18.104480 21916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:18.105093 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.104833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56876)
0809 02:23:18.104952 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.105029 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 02:23:18.105279 21824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
I20260809 02:23:18.106076 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.105843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56882)
0809 02:23:18.105960 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.106013 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:23:18.106213 21916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:38021: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
I20260809 02:23:18.106469 21780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } attempt: 3
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242197, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
I20260809 02:23:18.114678 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.106889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58068 (local address 127.1.81.253:34065)
0809 02:23:18.106998 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.107001 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.107015 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:23:18.107094 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.107097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.107137 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.107219 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.107541 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.108304 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.109413 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.110052 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.110133 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.112076 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.112079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.112081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.112103 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.113291 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.113720 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.113723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.113724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.113785 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.114008 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.114010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.114012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.114194 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.114267 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.114506 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.114585 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:23:18.114753 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.106807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:58068)
0809 02:23:18.106963 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.106975 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:18.107035 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:18.107225 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:18.107226 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:18.107353 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:18.107446 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.107451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.108441 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.108445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.109269 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.109283 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.110167 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.110171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.110281 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.110652 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:18.110668 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:18.111950 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:18.113393 (+ 1443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.113397 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.113399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.113632 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.113853 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.113856 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.113857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.113941 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.114274 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:18.114277 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:18.114371 (+ 94us) client_negotiation.cc:769] Sending connection context
0809 02:23:18.114467 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 02:23:18.114587 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260809 02:23:18.115356 21780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:18.116003 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.115733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56896)
0809 02:23:18.115864 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.115937 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 02:23:18.116684 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.116446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56906)
0809 02:23:18.116577 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.116623 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260809 02:23:18.116820 21780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:38021: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
I20260809 02:23:18.147960 21780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } attempt: 1
I20260809 02:23:18.148581 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.148312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56914)
0809 02:23:18.148444 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.148505 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 02:23:18.149235 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.149026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56918)
0809 02:23:18.149122 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.149174 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 02:23:18.149362 21780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:38021: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
I20260809 02:23:18.155450 21916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } attempt: 1
I20260809 02:23:18.156100 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.155853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56928)
0809 02:23:18.155972 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.156030 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:23:18.156744 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.156529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56944)
0809 02:23:18.156628 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.156685 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 02:23:18.156867 21916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:38021: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
W20260809 02:23:18.212430 21922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:18.212641 21922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:18.212683 21922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:18.216511 21922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:18.216557 21922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:18.216575 21922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:18.216604 21922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:18.216630 21922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:18.221520 21922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:36893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:39293,127.1.81.253:34065,127.1.81.252:38021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab
--principal=kudu/127.1.81.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.252:38021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.81.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:18.222402 21922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:18.223279 21922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:23:18.224489 21780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } attempt: 2
I20260809 02:23:18.225000 21916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } attempt: 2
I20260809 02:23:18.225338 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.224989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56946)
0809 02:23:18.225190 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.225252 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260809 02:23:18.225589 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.225348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56950)
0809 02:23:18.225464 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.225518 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 02:23:18.226152 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.225812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56956)
0809 02:23:18.226020 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.226071 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":90,"threads_started":1}
I20260809 02:23:18.226256 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.226017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56958)
0809 02:23:18.226143 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.226204 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260809 02:23:18.226320 21780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:38021: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
W20260809 02:23:18.226372 21916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:38021: Network error: Client connection negotiation failed: client connection to 127.1.81.252:38021: connect: Connection refused (error 111)
W20260809 02:23:18.231496 21934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:18.231501 21932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:18.231513 21936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:18.231789 21922 server_base.cc:1034] running on GCE node
I20260809 02:23:18.232327 21922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:18.233268 21922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:18.234416 21922 hybrid_clock.cc:648] HybridClock initialized: now 1786242198234396 us; error 30 us; skew 500 ppm
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:18.237040 21922 init.cc:377] Logged in from keytab as kudu/127.1.81.252@KRBTEST.COM (short username kudu)
I20260809 02:23:18.237824 21922 webserver.cc:460] Webserver started at http://127.1.81.252:34205/ using document root <none> and password file <none>
I20260809 02:23:18.238299 21922 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:18.238359 21922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:18.238543 21922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:18.240440 21922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/data/instance:
uuid: "cb108eae1d3e478ca76edcea4b17319e"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-jlzn"
server_key: "17c9e11f7427dba870274b82e6ba761c"
server_key_iv: "72bf838ea7f11257d8bd2d4aede86e18"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.240947 21922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/wal/instance:
uuid: "cb108eae1d3e478ca76edcea4b17319e"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-jlzn"
server_key: "17c9e11f7427dba870274b82e6ba761c"
server_key_iv: "72bf838ea7f11257d8bd2d4aede86e18"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.244395 21922 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:18.246569 21948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:18.247720 21922 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:18.247845 21922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/wal
uuid: "cb108eae1d3e478ca76edcea4b17319e"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-jlzn"
server_key: "17c9e11f7427dba870274b82e6ba761c"
server_key_iv: "72bf838ea7f11257d8bd2d4aede86e18"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.247932 21922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:18.275175 21922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:18.277541 21922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:18.277676 21922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:18.284021 21922 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.252:38021
I20260809 02:23:18.284067 22022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.252:38021 every 8 connection(s)
I20260809 02:23:18.284848 21922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
I20260809 02:23:18.287369 22023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:18.288100 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 21922
I20260809 02:23:18.288208 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242040541704-1351-0/minicluster-data/master-2/wal/instance
I20260809 02:23:18.288477 1351 external_mini_cluster.cc:1428] Setting key 3de3cb355e0df1825a0d61a8cc905c36
I20260809 02:23:18.291188 22023 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:18.301306 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.292729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49200 (local address 127.1.81.254:39293)
0809 02:23:18.292863 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.292867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.293228 (+ 361us) server_negotiation.cc:407] Connection header received
0809 02:23:18.293346 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.293349 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.293398 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.293468 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.294061 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.294523 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.295480 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.295854 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.295963 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.298169 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.298172 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.298175 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.298203 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.299458 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.300052 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.300056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.300057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.300145 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.300421 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.300424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.300426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.300646 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.300758 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.301060 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.301170 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:23:18.301580 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.289679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56970 (local address 127.1.81.252:38021)
0809 02:23:18.290086 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.290100 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.290131 (+ 31us) server_negotiation.cc:407] Connection header received
0809 02:23:18.290743 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.290758 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.291043 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.291316 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.292126 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.293146 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.294057 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.294515 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.294709 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.297206 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.297211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.297220 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.297242 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.298930 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.299318 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.299324 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.299330 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.299459 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.299679 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.299681 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.299683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.300080 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.300284 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.300537 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.300798 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":280,"thread_start_us":136,"threads_started":1}
I20260809 02:23:18.301590 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.292663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:39293 (local address 127.0.0.1:49200)
0809 02:23:18.293089 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.293134 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:18.293262 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:18.293518 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:18.293522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:18.293808 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:18.293942 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.293948 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.294637 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.294640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.295354 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.295365 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.295993 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.295997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.296101 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.296553 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:18.296571 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:18.298020 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:18.299698 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.299706 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.299710 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.299963 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.300234 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.300237 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.300239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.300331 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.300768 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:18.300773 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:18.300866 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 02:23:18.300972 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:23:18.301091 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":50,"thread_start_us":108,"threads_started":1}
I20260809 02:23:18.302585 22023 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:18.310835 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.302958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:34065 (local address 127.0.0.1:58074)
0809 02:23:18.303208 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.303220 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:18.303295 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:18.303522 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:18.303525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:18.303679 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:18.304200 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.304211 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.305124 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.305127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.305839 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.305849 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.306258 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.306261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.306330 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.306686 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:18.306698 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:18.308011 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:18.309535 (+ 1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.309539 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.309541 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.309725 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.309974 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.309977 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.309979 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.310056 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.310393 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:18.310396 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:18.310480 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 02:23:18.310577 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 02:23:18.310694 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184}
I20260809 02:23:18.310887 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.303083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58074 (local address 127.1.81.253:34065)
0809 02:23:18.303199 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.303203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.303260 (+ 57us) server_negotiation.cc:407] Connection header received
0809 02:23:18.303366 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.303369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.303413 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.303484 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.304340 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.305020 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.305943 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.306154 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.306252 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.308151 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.308156 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.308159 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.308188 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.309431 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.309812 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.309816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.309818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.309893 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.310135 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.310138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.310140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.310304 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.310386 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.310646 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.310760 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:23:18.311637 22023 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:18.311707 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.303618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49214 (local address 127.1.81.254:39293)
0809 02:23:18.303719 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.303723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.303735 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:23:18.303875 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.303878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.303913 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.303970 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.304578 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.305236 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.306170 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.306437 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.306521 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.308854 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.308858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.308861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.308886 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.310077 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.310451 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.310454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.310455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.310523 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.310760 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.310763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.310765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.310946 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.311140 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.311442 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.311566 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
I20260809 02:23:18.317492 21916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } attempt: 3
I20260809 02:23:18.320176 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.312079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56982)
0809 02:23:18.312171 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.312182 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:18.312258 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:18.312435 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:18.312438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:18.312577 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:18.312777 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.312787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.313681 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.313684 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.314438 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.314447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.314969 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.314971 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.315024 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.315357 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:18.315371 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:18.316480 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:18.318067 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.318070 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.318072 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.318959 (+ 887us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.319208 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.319211 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.319213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.319295 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.319654 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:18.319658 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:18.319750 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 02:23:18.319875 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 02:23:18.320001 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 02:23:18.320186 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.312109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56982 (local address 127.1.81.252:38021)
0809 02:23:18.312189 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.312193 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.312222 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:23:18.312320 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.312323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.312354 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.312414 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.312896 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.313588 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.314530 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.314880 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.314973 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.316627 (+ 1654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.316632 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.316634 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.316669 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.317947 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.319048 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.319051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.319052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.319124 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.319374 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.319377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.319379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.319567 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.319657 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.319936 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.320055 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":35}
I20260809 02:23:18.321170 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.312693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58082 (local address 127.1.81.253:34065)
0809 02:23:18.312793 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.312796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.312809 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:23:18.312846 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.312849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.312888 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.312951 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.313579 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.314273 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.315159 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.315418 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.315520 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.317679 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.317682 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.317685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.317709 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.319210 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.319589 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.319592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.319594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.319686 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.320005 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.320009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.320010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.320211 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.320400 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.320925 (+ 525us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.321022 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
I20260809 02:23:18.323210 22023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e: Bootstrap starting.
I20260809 02:23:18.324663 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:18.325474 21780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } attempt: 3
I20260809 02:23:18.326359 22023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:18.327373 22023 log.cc:824] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:18.328281 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.317825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:56992)
0809 02:23:18.318035 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.318048 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:18.318112 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:18.318672 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:18.318674 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:18.318867 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:18.318957 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.318964 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.319954 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.319957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.320689 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.320700 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.321305 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.321309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.321376 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.321747 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:18.321760 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:18.323039 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:18.325087 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.325090 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.325092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.325341 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.325653 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.325656 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.325658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.325751 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.327840 (+ 2089us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:18.327843 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:18.327936 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 02:23:18.328013 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:23:18.328131 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260809 02:23:18.328769 22032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.318178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56992 (local address 127.1.81.252:38021)
0809 02:23:18.318448 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.318456 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.318469 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:23:18.318501 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.318503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.318541 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.318631 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.319091 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.319834 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.320827 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.321178 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.321543 (+ 365us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.323194 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.323198 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.323200 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.323225 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.324883 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.325462 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.325465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.325467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.325549 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.326003 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.326006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.326008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.326241 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.328440 (+ 2199us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.328515 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.328618 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":95,"threads_started":1}
Aug 09 02:23:18 dist-test-slave-jlzn krb5kdc[21666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242197, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
I20260809 02:23:18.331460 21916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b: Bootstrap starting.
I20260809 02:23:18.334131 21916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:18.334846 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.325833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:38021 (local address 127.0.0.1:57008)
0809 02:23:18.325945 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:18.325960 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:18.326036 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:18.326598 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:18.326601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:18.326761 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:18.326850 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.326857 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.327785 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.327788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.328544 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:18.328556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.329276 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.329279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:18.329357 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.329800 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:18.329814 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:18.331561 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:18.333305 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.333308 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.333310 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.333546 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.333851 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:18.333854 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:18.333856 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:18.333946 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:18.334385 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:18.334389 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:18.334489 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 02:23:18.334574 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:23:18.334694 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:23:18.335259 21916 log.cc:824] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:18.335405 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.325915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57008 (local address 127.1.81.252:38021)
0809 02:23:18.326387 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.326391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.326401 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:18.326430 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.326433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.326468 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.326954 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.327031 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.327675 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.328867 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.329161 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.330287 (+ 1126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.331702 (+ 1415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.331706 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.331708 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.331731 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.333197 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.333655 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.333658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.333660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.333739 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.334055 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.334058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.334060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.334266 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.335102 (+ 836us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.335189 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.335289 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407}
I20260809 02:23:18.338199 21780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: Bootstrap starting.
I20260809 02:23:18.338320 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.326715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58088 (local address 127.1.81.253:34065)
0809 02:23:18.326805 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.326808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.328985 (+ 2177us) server_negotiation.cc:407] Connection header received
0809 02:23:18.329156 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.329159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.329199 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.329246 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.329927 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.330573 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.331675 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.332233 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.332306 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.334531 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.334534 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.334537 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.334561 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.336490 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.337061 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.337065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.337067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.337150 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.337430 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.337433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.337435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.337620 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.337739 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.338090 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.338193 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:23:18.338603 22032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.328340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57022 (local address 127.1.81.252:38021)
0809 02:23:18.329252 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.329255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.330178 (+ 923us) server_negotiation.cc:407] Connection header received
0809 02:23:18.330214 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.330217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.330255 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.330312 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.331181 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.331911 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.333066 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.333391 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.333477 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.335010 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.335013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.335015 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.335041 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.336475 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.337024 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.337028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.337030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.337118 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.337427 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.337430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.337432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.337626 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.337765 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.338367 (+ 602us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.338468 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":862,"thread_start_us":99,"threads_started":1}
I20260809 02:23:18.340631 21780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:18.341408 21780 log.cc:824] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:18.341477 21916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b: No bootstrap required, opened a new log
I20260809 02:23:18.341497 22023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e: No bootstrap required, opened a new log
I20260809 02:23:18.343132 21780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: No bootstrap required, opened a new log
I20260809 02:23:18.343462 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.326722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49228 (local address 127.1.81.254:39293)
0809 02:23:18.327851 (+ 1129us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.327855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.327866 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:18.327895 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.327897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.327933 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.328008 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.335968 (+ 7960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.336655 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.337648 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.337937 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.338009 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.339992 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.339996 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.339999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.340024 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.341532 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.342120 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.342124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.342126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.342213 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.342525 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.342528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.342530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.342748 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.342840 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.343206 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.343317 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":1039}
I20260809 02:23:18.345497 22023 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.345510 21916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.345690 22023 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:18.345712 21916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:18.345739 22023 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb108eae1d3e478ca76edcea4b17319e, State: Initialized, Role: FOLLOWER
I20260809 02:23:18.345768 21916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68515bba9c394895b03f47720d87f51b, State: Initialized, Role: FOLLOWER
I20260809 02:23:18.346148 22023 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.346241 21916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.346719 22051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.347011 22051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:18.347018 21780 raft_consensus.cc:348] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.347250 21780 raft_consensus.cc:374] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:18.347307 21780 raft_consensus.cc:729] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150d842a91ba4a1992a1d474a8ee16d0, State: Initialized, Role: FOLLOWER
I20260809 02:23:18.347378 22023 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:18.347515 21916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:18.347704 21780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.348166 22056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.348356 22056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:18.348877 21780 sys_catalog.cc:564] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:18.351560 22050 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.351687 22050 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:23:18.353698 22089 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:18.353775 22089 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260809 02:23:18.354487 22093 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:18.354553 22093 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:18.352089 21794 master_runner.cc:186] Error getting master registration for 127.1.81.254:39293: OK, instance_id { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" instance_seqno: 1786242197867670 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:23:18.356102 21794 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 02:23:18.358703 22106 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:18.358837 22106 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:18.359170 21922 master_runner.cc:263] No leader master found from master cb108eae1d3e478ca76edcea4b17319e
I20260809 02:23:18.359234 21922 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:23:18.359979 21683 master_runner.cc:263] No leader master found from master 150d842a91ba4a1992a1d474a8ee16d0
I20260809 02:23:18.360036 21683 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 02:23:18.364323 21717 tablet.cc:2369] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:18.369326 22050 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:18.369477 22050 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.370728 21868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb108eae1d3e478ca76edcea4b17319e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68515bba9c394895b03f47720d87f51b" is_pre_election: true
I20260809 02:23:18.371027 21868 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb108eae1d3e478ca76edcea4b17319e in term 0.
I20260809 02:23:18.371435 21952 leader_election.cc:302] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68515bba9c394895b03f47720d87f51b, cb108eae1d3e478ca76edcea4b17319e; no voters:
I20260809 02:23:18.371940 22050 leader_election.cc:288] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150d842a91ba4a1992a1d474a8ee16d0 (127.1.81.254:39293), 68515bba9c394895b03f47720d87f51b (127.1.81.253:34065)
I20260809 02:23:18.372046 22050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:18.372120 22050 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:18.372180 22050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:18.372222 21745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb108eae1d3e478ca76edcea4b17319e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d842a91ba4a1992a1d474a8ee16d0" is_pre_election: true
I20260809 02:23:18.372463 21745 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb108eae1d3e478ca76edcea4b17319e in term 0.
I20260809 02:23:18.374816 22050 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.375448 21868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb108eae1d3e478ca76edcea4b17319e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68515bba9c394895b03f47720d87f51b"
I20260809 02:23:18.375558 21868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:18.375936 21745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb108eae1d3e478ca76edcea4b17319e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150d842a91ba4a1992a1d474a8ee16d0"
I20260809 02:23:18.376077 21745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:18.376770 21868 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb108eae1d3e478ca76edcea4b17319e in term 1.
I20260809 02:23:18.377070 21952 leader_election.cc:302] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68515bba9c394895b03f47720d87f51b, cb108eae1d3e478ca76edcea4b17319e; no voters:
I20260809 02:23:18.377228 22050 leader_election.cc:288] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [CANDIDATE]: Term 1 election: Requested vote from peers 150d842a91ba4a1992a1d474a8ee16d0 (127.1.81.254:39293), 68515bba9c394895b03f47720d87f51b (127.1.81.253:34065)
I20260809 02:23:18.377259 21745 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb108eae1d3e478ca76edcea4b17319e in term 1.
I20260809 02:23:18.377308 22050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:18.377429 22050 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [term 1 LEADER]: Becoming Leader. State: Replica: cb108eae1d3e478ca76edcea4b17319e, State: Running, Role: LEADER
I20260809 02:23:18.377756 22050 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } }
I20260809 02:23:18.379070 22050 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb108eae1d3e478ca76edcea4b17319e. Latest consensus state: current_term: 1 leader_uuid: "cb108eae1d3e478ca76edcea4b17319e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.379173 22050 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:18.380502 22115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:18.381412 22115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:18.386261 21868 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [term 1 FOLLOWER]: Refusing update from remote peer cb108eae1d3e478ca76edcea4b17319e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:18.388965 22050 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [LEADER]: Connected to new peer: Peer: permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:18.389856 21745 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [term 1 FOLLOWER]: Refusing update from remote peer cb108eae1d3e478ca76edcea4b17319e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:18.390442 22050 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [LEADER]: Connected to new peer: Peer: permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:18.392958 22051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb108eae1d3e478ca76edcea4b17319e. Latest consensus state: current_term: 1 leader_uuid: "cb108eae1d3e478ca76edcea4b17319e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.393064 22051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:18.393602 22056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb108eae1d3e478ca76edcea4b17319e. Latest consensus state: current_term: 1 leader_uuid: "cb108eae1d3e478ca76edcea4b17319e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.393698 22056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:18.401907 22116 mvcc.cc:205] Tried to move back new op lower bound from 7316448044583628800 to 7316448044557606912. Current Snapshot: MvccSnapshot[applied={T|T < 7316448044583628800}]
I20260809 02:23:18.402097 22113 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb108eae1d3e478ca76edcea4b17319e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.402197 22113 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:18.402599 22050 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb108eae1d3e478ca76edcea4b17319e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.402689 22050 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:18.403049 22051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb108eae1d3e478ca76edcea4b17319e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.403149 22051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:18.403596 22056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb108eae1d3e478ca76edcea4b17319e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150d842a91ba4a1992a1d474a8ee16d0" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 39293 } } peers { permanent_uuid: "68515bba9c394895b03f47720d87f51b" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 34065 } } peers { permanent_uuid: "cb108eae1d3e478ca76edcea4b17319e" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 38021 } } }
I20260809 02:23:18.403687 22056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:18.404807 22119 mvcc.cc:205] Tried to move back new op lower bound from 7316448044583628800 to 7316448044557606912. Current Snapshot: MvccSnapshot[applied={T|T < 7316448044583628800}]
I20260809 02:23:18.406018 22117 mvcc.cc:205] Tried to move back new op lower bound from 7316448044583628800 to 7316448044557606912. Current Snapshot: MvccSnapshot[applied={T|T < 7316448044583628800}]
I20260809 02:23:18.417217 22115 catalog_manager.cc:1347] Generated new cluster ID: 6e27c2c2ccc346e6a89b20bbc6e3e656
I20260809 02:23:18.417284 22115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:18.442543 22115 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:18.443787 22115 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:18.459082 22115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb108eae1d3e478ca76edcea4b17319e: Generated new TSK 0
I20260809 02:23:18.459774 22115 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:19.355077 22089 catalog_manager.cc:1259] Loaded cluster ID: 6e27c2c2ccc346e6a89b20bbc6e3e656
I20260809 02:23:19.355155 22089 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b: loading cluster ID for follower catalog manager: success
I20260809 02:23:19.356834 22089 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b: acquiring CA information for follower catalog manager: success
I20260809 02:23:19.357959 22089 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 68515bba9c394895b03f47720d87f51b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:23:19.359905 22106 catalog_manager.cc:1259] Loaded cluster ID: 6e27c2c2ccc346e6a89b20bbc6e3e656
I20260809 02:23:19.359964 22106 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: loading cluster ID for follower catalog manager: success
I20260809 02:23:19.361377 22106 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: acquiring CA information for follower catalog manager: success
I20260809 02:23:19.362326 22106 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 150d842a91ba4a1992a1d474a8ee16d0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:23:19.518416 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 21683
I20260809 02:23:19.534634 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 21794
W20260809 02:23:19.544283 21952 connection.cc:535] client connection to 127.1.81.253:34065 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 02:23:19.544483 21952 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:23:19.544517 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 21922
2026-08-09T02:23:19Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3080 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:19 dist-test-slave-jlzn krb5kdc[22139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:19 dist-test-slave-jlzn krb5kdc[22139](info): set up 2 sockets
Aug 09 02:23:19 dist-test-slave-jlzn krb5kdc[22139](info): commencing operation
krb5kdc: starting...
W20260809 02:23:20.662842 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:23:20 dist-test-slave-jlzn krb5kdc[22139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:23:20.774716 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44341
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:44341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:20.882395 22156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:20.882624 22156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:20.882665 22156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:20.886547 22156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:20.886596 22156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:20.886616 22156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:20.886646 22156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:20.886672 22156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:20.891671 22156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:44341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:20.892566 22156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:20.893546 22156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:20.901435 22168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:20.901484 22156 server_base.cc:1034] running on GCE node
W20260809 02:23:20.901472 22166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:20.901444 22164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:20.902310 22156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:20.903276 22156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:20.904431 22156 hybrid_clock.cc:648] HybridClock initialized: now 1786242200904415 us; error 28 us; skew 500 ppm
Aug 09 02:23:20 dist-test-slave-jlzn krb5kdc[22139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242200, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:20.907002 22156 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:23:20.907773 22156 webserver.cc:460] Webserver started at http://127.1.81.254:42583/ using document root <none> and password file <none>
I20260809 02:23:20.908282 22156 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:20.908349 22156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:20.908524 22156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:20.910439 22156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "fd00289ab9be4531b71b5cfcfe526a07"
format_stamp: "Formatted at 2026-08-09 02:23:20 on dist-test-slave-jlzn"
server_key: "13aca96945e1f65ed728aa985fc06a3c"
server_key_iv: "fe2e1ab96f6aa266ac62eff4f6474a61"
server_key_version: "encryptionkey@0"
I20260809 02:23:20.910952 22156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "fd00289ab9be4531b71b5cfcfe526a07"
format_stamp: "Formatted at 2026-08-09 02:23:20 on dist-test-slave-jlzn"
server_key: "13aca96945e1f65ed728aa985fc06a3c"
server_key_iv: "fe2e1ab96f6aa266ac62eff4f6474a61"
server_key_version: "encryptionkey@0"
I20260809 02:23:20.914322 22156 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:23:20.916462 22180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:20.917538 22156 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:20.917657 22156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "fd00289ab9be4531b71b5cfcfe526a07"
format_stamp: "Formatted at 2026-08-09 02:23:20 on dist-test-slave-jlzn"
server_key: "13aca96945e1f65ed728aa985fc06a3c"
server_key_iv: "fe2e1ab96f6aa266ac62eff4f6474a61"
server_key_version: "encryptionkey@0"
I20260809 02:23:20.917747 22156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:20.952250 22156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:20.954739 22156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:20.954907 22156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:20.961447 22156 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:44341
I20260809 02:23:20.961460 22257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:44341 every 8 connection(s)
I20260809 02:23:20.962302 22156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:20.964888 22259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:20.970144 22259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07: Bootstrap starting.
I20260809 02:23:20.970510 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 22156
I20260809 02:23:20.970624 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:23:20.970882 1351 external_mini_cluster.cc:1428] Setting key 398683436fcbdc74fd0280b275ea4016
I20260809 02:23:20.972635 22259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:20.973508 22259 log.cc:824] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:20.975505 22259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07: No bootstrap required, opened a new log
I20260809 02:23:20.979387 22259 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd00289ab9be4531b71b5cfcfe526a07" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44341 } }
Aug 09 02:23:20 dist-test-slave-jlzn krb5kdc[22139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:20.979664 22259 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:20.979723 22259 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd00289ab9be4531b71b5cfcfe526a07, State: Initialized, Role: FOLLOWER
I20260809 02:23:20.980194 22259 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd00289ab9be4531b71b5cfcfe526a07" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44341 } }
I20260809 02:23:20.980369 22259 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:20.980443 22259 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:20.980554 22259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:20.981338 22259 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd00289ab9be4531b71b5cfcfe526a07" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44341 } }
I20260809 02:23:20.981654 22259 leader_election.cc:302] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd00289ab9be4531b71b5cfcfe526a07; no voters:
I20260809 02:23:20.981923 22259 leader_election.cc:288] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:20.982054 22265 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:20.982231 22265 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [term 1 LEADER]: Becoming Leader. State: Replica: fd00289ab9be4531b71b5cfcfe526a07, State: Running, Role: LEADER
I20260809 02:23:20.982565 22265 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd00289ab9be4531b71b5cfcfe526a07" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44341 } }
I20260809 02:23:20.983136 22259 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:20.984210 22266 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd00289ab9be4531b71b5cfcfe526a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd00289ab9be4531b71b5cfcfe526a07" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44341 } } }
I20260809 02:23:20.984349 22266 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:20.984688 22268 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd00289ab9be4531b71b5cfcfe526a07. Latest consensus state: current_term: 1 leader_uuid: "fd00289ab9be4531b71b5cfcfe526a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd00289ab9be4531b71b5cfcfe526a07" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44341 } } }
I20260809 02:23:20.984774 22280 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:20.984859 22268 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:20.985046 22262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:20.972047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33982 (local address 127.1.81.254:44341)
0809 02:23:20.972464 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:20.972482 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:20.972523 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:23:20.973325 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:20.973349 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:20.973740 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:20.974055 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:20.974764 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:20.976200 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:20.976997 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:20.977685 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:20.977845 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:20.980228 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:20.980234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:20.980249 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:20.980278 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:20.981941 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:20.982421 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:20.982427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:20.982433 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:20.982567 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:20.982859 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:20.982863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:20.982865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:20.983253 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:20.983527 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:20.983698 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 02:23:20.984011 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":101,"threads_started":1}
I20260809 02:23:20.987890 22280 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:20.988202 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:20.993217 22280 catalog_manager.cc:1347] Generated new cluster ID: ce76da41a3144abf9f733215b2204450
I20260809 02:23:20.993283 22280 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:21.005080 22280 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:21.006166 22280 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:21.013686 22280 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd00289ab9be4531b71b5cfcfe526a07: Generated new TSK 0
I20260809 02:23:21.014230 22280 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:21.043231 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 22156
2026-08-09T02:23:21Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1505 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:21 dist-test-slave-jlzn krb5kdc[22301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:21 dist-test-slave-jlzn krb5kdc[22301](info): set up 2 sockets
Aug 09 02:23:21 dist-test-slave-jlzn krb5kdc[22301](info): commencing operation
krb5kdc: starting...
W20260809 02:23:22.169579 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:23:22 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:23:22.280860 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43585
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:43585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:22.385655 22322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:22.385878 22322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:22.385933 22322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:22.389780 22322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:22.389830 22322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:22.389858 22322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:22.389878 22322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:22.389906 22322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:22.394829 22322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:43585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:22.395670 22322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:22.396572 22322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:22.404285 22327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:22.404376 22328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:22.404278 22331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:22.404296 22322 server_base.cc:1034] running on GCE node
I20260809 02:23:22.404978 22322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:22.405932 22322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:22.407087 22322 hybrid_clock.cc:648] HybridClock initialized: now 1786242202407078 us; error 27 us; skew 500 ppm
Aug 09 02:23:22 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:22.409652 22322 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:23:22.410425 22322 webserver.cc:460] Webserver started at http://127.1.81.254:33339/ using document root <none> and password file <none>
I20260809 02:23:22.410923 22322 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:22.410986 22322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:22.411164 22322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:22.413085 22322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "7f85700440f1476994ed6a288dc019e3"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "e2f249afa4903ad8178db5ba7845dfe5"
server_key_iv: "139feb9f77e84cd156b299e869fca7fd"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.413621 22322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "7f85700440f1476994ed6a288dc019e3"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "e2f249afa4903ad8178db5ba7845dfe5"
server_key_iv: "139feb9f77e84cd156b299e869fca7fd"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.417057 22322 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 02:23:22.419216 22339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:22.420372 22322 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:22.420485 22322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "7f85700440f1476994ed6a288dc019e3"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "e2f249afa4903ad8178db5ba7845dfe5"
server_key_iv: "139feb9f77e84cd156b299e869fca7fd"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.420595 22322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:22.436997 22322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:22.439779 22322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:22.439960 22322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:22.446426 22322 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:43585
I20260809 02:23:22.446678 22413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:43585 every 8 connection(s)
I20260809 02:23:22.447268 22322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:22.449857 22414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:22.454910 22414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Bootstrap starting.
I20260809 02:23:22.455503 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 22322
I20260809 02:23:22.455632 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:23:22.455924 1351 external_mini_cluster.cc:1428] Setting key c8d863858eba10f23da79f90526ff5cf
I20260809 02:23:22.457331 22414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:22.458173 22414 log.cc:824] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:22.460198 22414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: No bootstrap required, opened a new log
I20260809 02:23:22.463891 22414 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:22.464135 22414 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:22.464195 22414 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f85700440f1476994ed6a288dc019e3, State: Initialized, Role: FOLLOWER
Aug 09 02:23:22 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:22.464637 22414 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:22.464793 22414 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:22.464856 22414 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:22.464947 22414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:22.465947 22414 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:22.466270 22414 leader_election.cc:302] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f85700440f1476994ed6a288dc019e3; no voters:
I20260809 02:23:22.466540 22414 leader_election.cc:288] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:22.466661 22421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:22.466856 22421 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 1 LEADER]: Becoming Leader. State: Replica: 7f85700440f1476994ed6a288dc019e3, State: Running, Role: LEADER
I20260809 02:23:22.467201 22421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:22.467706 22414 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:22.468750 22425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f85700440f1476994ed6a288dc019e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } } }
I20260809 02:23:22.468883 22425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:22.469074 22425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f85700440f1476994ed6a288dc019e3. Latest consensus state: current_term: 1 leader_uuid: "7f85700440f1476994ed6a288dc019e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } } }
I20260809 02:23:22.469146 22425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:22.470100 22437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:22.470386 22418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:22.456951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50182 (local address 127.1.81.254:43585)
0809 02:23:22.457406 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:22.457424 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:22.457466 (+ 42us) server_negotiation.cc:407] Connection header received
0809 02:23:22.458272 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:22.458295 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:22.458651 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:22.458942 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:22.459591 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.461015 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.461870 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.462577 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.462752 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:22.465192 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:22.465198 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:22.465213 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:22.465243 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:22.466898 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.467393 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.467399 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.467404 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.467536 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.467821 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.467825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.467826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.468278 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:22.469147 (+ 869us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:22.469292 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 02:23:22.469556 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":142,"threads_started":1}
I20260809 02:23:22.473097 22437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:22.478354 22437 catalog_manager.cc:1347] Generated new cluster ID: 03787d4c1fe24f75be0e407b01dcca33
I20260809 02:23:22.478416 22437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:22.490097 22437 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:22.490880 22437 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:22.501137 22437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Generated new TSK 0
I20260809 02:23:22.501670 22437 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:23:22.530611 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43585
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:22.659574 22452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:22.659780 22452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:22.659847 22452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:22.663628 22452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:22.663674 22452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:22.663726 22452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:23:22.668738 22452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:22.669580 22452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:22.670420 22452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:22.679075 22460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:22.679087 22465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:22.679113 22461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:22.679363 22452 server_base.cc:1034] running on GCE node
I20260809 02:23:22.679749 22452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:22.680330 22452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:22.681483 22452 hybrid_clock.cc:648] HybridClock initialized: now 1786242202681470 us; error 24 us; skew 500 ppm
Aug 09 02:23:22 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:22.683987 22452 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:23:22.684744 22452 webserver.cc:460] Webserver started at http://127.1.81.193:36805/ using document root <none> and password file <none>
I20260809 02:23:22.685221 22452 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:22.685282 22452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:22.685470 22452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:22.687291 22452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "0534c788cf604a8f942f4e21f6869739"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "1d5976b7a6f9f3cb65868e4e4941268a"
server_key_iv: "9f47f9f21a7bf2936c0bf16306c52486"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.687776 22452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "0534c788cf604a8f942f4e21f6869739"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "1d5976b7a6f9f3cb65868e4e4941268a"
server_key_iv: "9f47f9f21a7bf2936c0bf16306c52486"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.691041 22452 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:23:22.693202 22473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:22.694255 22452 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:22.694363 22452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "0534c788cf604a8f942f4e21f6869739"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "1d5976b7a6f9f3cb65868e4e4941268a"
server_key_iv: "9f47f9f21a7bf2936c0bf16306c52486"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.694451 22452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:22.712678 22452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:22.714968 22452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:22.715119 22452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:22.715618 22452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:22.716400 22452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:22.716449 22452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:22.716485 22452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:22.716516 22452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:22.724547 22452 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:37445
I20260809 02:23:22.724607 22641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:37445 every 8 connection(s)
I20260809 02:23:22.725317 22452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:22.726512 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 22452
I20260809 02:23:22.726649 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:22.726953 1351 external_mini_cluster.cc:1428] Setting key 37735c9d8cd3d9e14faca464636b0ca0
Aug 09 02:23:22 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:23:22.738837 22418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:22.726838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:50327 (local address 127.1.81.254:43585)
0809 02:23:22.726957 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:22.726961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:22.727907 (+ 946us) server_negotiation.cc:407] Connection header received
0809 02:23:22.729241 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:22.729244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:22.729298 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:22.729380 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:22.730452 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.731026 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.732513 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.732822 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.732927 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:22.735463 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:22.735467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:22.735470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:22.735499 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:22.736983 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.737450 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.737454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.737456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.737544 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.737834 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.737837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.737839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.738063 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:22.738175 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:22.738553 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 02:23:22.738648 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:23:22.739485 22647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:22.727262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:50327)
0809 02:23:22.727738 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:22.727790 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:22.729033 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:22.729508 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:22.729513 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:22.729845 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:22.730304 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:22.730323 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.731161 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.731165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:22.732367 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:22.732379 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.732978 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.732982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:22.733198 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:22.733759 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:22.733780 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:22.735300 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:22.737103 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:22.737107 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:22.737117 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:22.737353 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:22.737628 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:22.737630 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:22.737632 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:22.737754 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:22.738164 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:22.738169 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:22.738368 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 02:23:22.738509 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 02:23:22.738736 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
I20260809 02:23:22.740711 22642 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43585
I20260809 02:23:22.740918 22642 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:22.741326 22642 heartbeater.cc:511] Master 127.1.81.254:43585 requested a full tablet report, sending...
I20260809 02:23:22.742704 22362 ts_manager.cc:194] Registered new tserver with Master: 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445)
I20260809 02:23:22.743767 22362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:50327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:23:22.754604 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43585
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:22.864063 22652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:22.864351 22652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:22.864408 22652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:22.869552 22652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:22.869632 22652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:22.869700 22652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:23:22.874667 22652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:22.875542 22652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:22.876456 22652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:22.885159 22660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:22.885174 22657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:22.885170 22658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:22.885344 22652 server_base.cc:1034] running on GCE node
I20260809 02:23:22.885838 22652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:22.886406 22652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:22.887562 22652 hybrid_clock.cc:648] HybridClock initialized: now 1786242202887552 us; error 30 us; skew 500 ppm
Aug 09 02:23:22 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:22.890162 22652 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:23:22.890933 22652 webserver.cc:460] Webserver started at http://127.1.81.194:45235/ using document root <none> and password file <none>
I20260809 02:23:22.891414 22652 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:22.891474 22652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:22.891687 22652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:22.893599 22652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "ef31395791c341a483a9404b12d64c73"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "767f14f2ac435581eca16955b8dc3e88"
server_key_iv: "8af01894a3d946714225bee3da3975ca"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.894105 22652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "ef31395791c341a483a9404b12d64c73"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "767f14f2ac435581eca16955b8dc3e88"
server_key_iv: "8af01894a3d946714225bee3da3975ca"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.897624 22652 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:23:22.899922 22668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:22.901043 22652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:23:22.901139 22652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "ef31395791c341a483a9404b12d64c73"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "767f14f2ac435581eca16955b8dc3e88"
server_key_iv: "8af01894a3d946714225bee3da3975ca"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.901235 22652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:22.926710 22652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:22.929531 22652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:22.929699 22652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:22.930220 22652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:22.930979 22652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:22.931032 22652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:22.931084 22652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:22.931114 22652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:22.939260 22652 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:38513
I20260809 02:23:22.939306 22840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:38513 every 8 connection(s)
I20260809 02:23:22.940083 22652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:22.940699 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 22652
I20260809 02:23:22.940819 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:22.941087 1351 external_mini_cluster.cc:1428] Setting key 5c553ed886697fabc68b437f92f614a2
Aug 09 02:23:22 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
I20260809 02:23:22.953814 22418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:22.941898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:58773 (local address 127.1.81.254:43585)
0809 02:23:22.942007 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:22.942010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:22.942815 (+ 805us) server_negotiation.cc:407] Connection header received
0809 02:23:22.944363 (+ 1548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:22.944366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:22.944409 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:22.944475 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:22.945689 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.946203 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.947676 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.947933 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.948012 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:22.950647 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:22.950650 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:22.950652 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:22.950675 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:22.952069 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.952619 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.952621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.952623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.952699 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.952966 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.952968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.952970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.953119 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:22.953196 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:22.953606 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 02:23:22.953698 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:23:22.954471 22843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:22.942154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:58773)
0809 02:23:22.942656 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:22.942712 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:22.944154 (+ 1442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:22.944668 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:22.944676 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:22.945111 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:22.945548 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:22.945562 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.946326 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.946330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:22.947559 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:22.947572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.948092 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.948098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:22.948290 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:22.948801 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:22.948821 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:22.950486 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:22.952177 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:22.952183 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:22.952196 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:22.952524 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:22.952773 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:22.952775 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:22.952776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:22.952902 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:22.953189 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:22.953194 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:22.953411 (+ 217us) client_negotiation.cc:769] Sending connection context
0809 02:23:22.953553 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 02:23:22.953778 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":129,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
I20260809 02:23:22.955472 22841 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43585
I20260809 02:23:22.955729 22841 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:22.956274 22841 heartbeater.cc:511] Master 127.1.81.254:43585 requested a full tablet report, sending...
I20260809 02:23:22.957334 22362 ts_manager.cc:194] Registered new tserver with Master: ef31395791c341a483a9404b12d64c73 (127.1.81.194:38513)
I20260809 02:23:22.958047 22362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:58773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:23:22.967877 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43585
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:23.073908 22846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:23.074108 22846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:23.074152 22846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:23.078085 22846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:23.078135 22846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:23.078198 22846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:23:23.083065 22846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:23.083887 22846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:23.084724 22846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:23.093662 22860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:23.093672 22854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:23.093711 22857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:23.093978 22846 server_base.cc:1034] running on GCE node
I20260809 02:23:23.094327 22846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:23.094864 22846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:23.096005 22846 hybrid_clock.cc:648] HybridClock initialized: now 1786242203095987 us; error 31 us; skew 500 ppm
Aug 09 02:23:23 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242203, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:23.098565 22846 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:23:23.099313 22846 webserver.cc:460] Webserver started at http://127.1.81.195:38863/ using document root <none> and password file <none>
I20260809 02:23:23.099773 22846 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:23.099861 22846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:23.100049 22846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:23.101792 22846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "8b045424110f41f09edcf4e0aee8e2d6"
format_stamp: "Formatted at 2026-08-09 02:23:23 on dist-test-slave-jlzn"
server_key: "12a3dda555630e823efc9a0c17e61445"
server_key_iv: "7efefb70d11ff07b06f8607a45d58441"
server_key_version: "encryptionkey@0"
I20260809 02:23:23.102275 22846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "8b045424110f41f09edcf4e0aee8e2d6"
format_stamp: "Formatted at 2026-08-09 02:23:23 on dist-test-slave-jlzn"
server_key: "12a3dda555630e823efc9a0c17e61445"
server_key_iv: "7efefb70d11ff07b06f8607a45d58441"
server_key_version: "encryptionkey@0"
I20260809 02:23:23.105615 22846 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:23:23.107663 22870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:23.108747 22846 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:23.108860 22846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "8b045424110f41f09edcf4e0aee8e2d6"
format_stamp: "Formatted at 2026-08-09 02:23:23 on dist-test-slave-jlzn"
server_key: "12a3dda555630e823efc9a0c17e61445"
server_key_iv: "7efefb70d11ff07b06f8607a45d58441"
server_key_version: "encryptionkey@0"
I20260809 02:23:23.108945 22846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:23.120656 22846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:23.122956 22846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:23.123113 22846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:23.123617 22846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:23.124419 22846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:23.124466 22846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:23.124514 22846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:23.124542 22846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:23.132663 22846 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:36399
I20260809 02:23:23.132721 23037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:36399 every 8 connection(s)
I20260809 02:23:23.133397 22846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:23.133612 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 22846
I20260809 02:23:23.133709 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:23.133976 1351 external_mini_cluster.cc:1428] Setting key 3889f78f7f4924a814d6b0263dcc3e6f
Aug 09 02:23:23 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242203, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:23.145336 22418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.134967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:33893 (local address 127.1.81.254:43585)
0809 02:23:23.135085 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.135090 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.135953 (+ 863us) server_negotiation.cc:407] Connection header received
0809 02:23:23.137180 (+ 1227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.137184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.137237 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.137305 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:23.138330 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.138840 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.139941 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.140166 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.140253 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.142332 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:23.142336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:23.142337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:23.142361 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:23.143465 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.143969 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.143972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.143975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.144052 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.144368 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.144370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.144371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.144534 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:23.144620 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.145068 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.145183 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:23:23.145948 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.135354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:33893)
0809 02:23:23.135817 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.135869 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.136993 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.137468 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.137475 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.137791 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:23.138199 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.138212 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.138955 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.138959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.139836 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.139847 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.140295 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.140300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.140463 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.140890 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:23.140905 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:23.142189 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:23.143589 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:23.143595 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:23.143607 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:23.143884 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:23.144140 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:23.144144 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:23.144146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:23.144274 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:23.144634 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:23.144640 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:23.144844 (+ 204us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.144984 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.145255 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":135,"threads_started":1}
I20260809 02:23:23.146943 23038 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43585
I20260809 02:23:23.147153 23038 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:23.147584 23038 heartbeater.cc:511] Master 127.1.81.254:43585 requested a full tablet report, sending...
I20260809 02:23:23.148515 22362 ts_manager.cc:194] Registered new tserver with Master: 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399)
I20260809 02:23:23.149042 22362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:33893
I20260809 02:23:23.159170 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:23.166729 22418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.160959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50190 (local address 127.1.81.254:43585)
0809 02:23:23.161083 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.161087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.161220 (+ 133us) server_negotiation.cc:407] Connection header received
0809 02:23:23.161306 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.161308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.161342 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.161402 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:23.161981 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.162445 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.163163 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.163349 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.163410 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.164469 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:23.164472 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:23.164473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:23.164489 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:23.165518 (+ 1029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.165856 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.165858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.165859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.165920 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.166090 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.166091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.166092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.166274 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:23.166371 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.166513 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.166593 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:23:23.169248 22362 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50190:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:23.172046 22362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:23.185487 23063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.179558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36399 (local address 127.0.0.1:47066)
0809 02:23:23.180349 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.180362 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.180453 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.181163 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.181169 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.181191 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:23.181302 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.181308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.182651 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.182654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.184193 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.184205 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.184978 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.184981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.185094 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.185132 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.185238 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.185347 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":174,"thread_start_us":114,"threads_started":1}
I20260809 02:23:23.185613 23060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.179557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55426 (local address 127.1.81.194:38513)
0809 02:23:23.180721 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.180734 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.180755 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:23:23.180831 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.180836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.180976 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.181112 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:23.181471 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.182468 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.184319 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.185089 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.185183 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.185298 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.185378 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.185470 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1060,"thread_start_us":121,"threads_started":1}
I20260809 02:23:23.185720 23058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.180064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37445 (local address 127.0.0.1:34804)
0809 02:23:23.180645 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.180669 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.180745 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.181503 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.181506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.181545 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:23.181636 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.181643 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.183066 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.183069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.184101 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.184111 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.185351 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.185355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.185442 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.185465 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.185536 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.185598 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"mutex_wait_us":79,"thread_start_us":87,"threads_started":1}
I20260809 02:23:23.185503 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.179414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:38513 (local address 127.0.0.1:55426)
0809 02:23:23.180296 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.180341 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.180447 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.181291 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.181293 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.181308 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:23.181378 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.181384 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.182597 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.182600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.184193 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.184205 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.185184 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.185188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.185270 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.185290 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.185349 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.185402 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"mutex_wait_us":124,"thread_start_us":63,"threads_started":1}
I20260809 02:23:23.186079 23062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.179873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47066 (local address 127.1.81.195:36399)
0809 02:23:23.180681 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.180697 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.180717 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:23:23.180782 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.180787 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.180966 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.181160 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:23.181415 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.182487 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.184335 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.184860 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.184956 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.185086 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.185861 (+ 775us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.185952 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":109,"threads_started":1}
I20260809 02:23:23.186281 23064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.180277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34804 (local address 127.1.81.193:37445)
0809 02:23:23.181015 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.181028 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.181048 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:23:23.181122 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.181127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.181294 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.181747 (+ 453us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:23.181917 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.182920 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.184219 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.185023 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.185130 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.185283 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.185885 (+ 602us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.185984 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":118,"threads_started":1}
I20260809 02:23:23.188841 22937 tablet_service.cc:1467] Processing CreateTablet for tablet 0639f4287a814bcca4f11c2917cd6831 (DEFAULT_TABLE table=test-table [id=e907e4491e114b3e82e9cb09dd1cf67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:23.188841 22541 tablet_service.cc:1467] Processing CreateTablet for tablet 0639f4287a814bcca4f11c2917cd6831 (DEFAULT_TABLE table=test-table [id=e907e4491e114b3e82e9cb09dd1cf67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:23.189260 22744 tablet_service.cc:1467] Processing CreateTablet for tablet 0639f4287a814bcca4f11c2917cd6831 (DEFAULT_TABLE table=test-table [id=e907e4491e114b3e82e9cb09dd1cf67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:23.189898 22937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0639f4287a814bcca4f11c2917cd6831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:23.189890 22541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0639f4287a814bcca4f11c2917cd6831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:23.190199 22744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0639f4287a814bcca4f11c2917cd6831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:23.196193 23067 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: Bootstrap starting.
I20260809 02:23:23.197417 23069 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Bootstrap starting.
I20260809 02:23:23.197834 23071 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: Bootstrap starting.
I20260809 02:23:23.198891 23067 tablet_bootstrap.cc:654] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:23.199824 23067 log.cc:824] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:23.199961 23071 tablet_bootstrap.cc:654] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:23.201119 23071 log.cc:824] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:23.201749 23069 tablet_bootstrap.cc:654] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:23.202198 23067 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: No bootstrap required, opened a new log
I20260809 02:23:23.202401 23067 ts_tablet_manager.cc:1397] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:23:23.202765 23071 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: No bootstrap required, opened a new log
I20260809 02:23:23.202930 23071 ts_tablet_manager.cc:1397] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260809 02:23:23.202907 23069 log.cc:824] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:23.204800 23069 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: No bootstrap required, opened a new log
I20260809 02:23:23.204977 23069 ts_tablet_manager.cc:1397] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260809 02:23:23.205973 23071 raft_consensus.cc:348] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.206189 23071 raft_consensus.cc:374] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:23.206033 23067 raft_consensus.cc:348] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.206252 23071 raft_consensus.cc:729] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b045424110f41f09edcf4e0aee8e2d6, State: Initialized, Role: FOLLOWER
I20260809 02:23:23.206279 23067 raft_consensus.cc:374] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:23.206322 23067 raft_consensus.cc:729] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef31395791c341a483a9404b12d64c73, State: Initialized, Role: FOLLOWER
I20260809 02:23:23.206681 23071 consensus_queue.cc:260] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.206748 23067 consensus_queue.cc:260] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.207285 23038 heartbeater.cc:503] Master 127.1.81.254:43585 was elected leader, sending a full tablet report...
I20260809 02:23:23.208076 23067 ts_tablet_manager.cc:1428] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:23:23.208405 22841 heartbeater.cc:503] Master 127.1.81.254:43585 was elected leader, sending a full tablet report...
I20260809 02:23:23.208539 23069 raft_consensus.cc:348] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.208732 23069 raft_consensus.cc:374] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:23.208788 23069 raft_consensus.cc:729] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0534c788cf604a8f942f4e21f6869739, State: Initialized, Role: FOLLOWER
I20260809 02:23:23.209131 23069 consensus_queue.cc:260] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.209465 23071 ts_tablet_manager.cc:1428] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260809 02:23:23.210073 23069 ts_tablet_manager.cc:1428] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:23:23.210201 22642 heartbeater.cc:503] Master 127.1.81.254:43585 was elected leader, sending a full tablet report...
W20260809 02:23:23.226290 22645 tablet.cc:2369] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:23.316550 23077 raft_consensus.cc:482] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:23.316735 23077 raft_consensus.cc:504] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.317734 23077 leader_election.cc:288] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef31395791c341a483a9404b12d64c73 (127.1.81.194:38513), 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399)
I20260809 02:23:23.322782 23060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.318034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:43385 (local address 127.1.81.194:38513)
0809 02:23:23.318168 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.318173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.318428 (+ 255us) server_negotiation.cc:407] Connection header received
0809 02:23:23.318523 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.318525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.318568 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.318647 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:23.319057 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.319864 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.321600 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.322220 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.322334 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.322384 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.322588 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.322656 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:23:23.322782 23062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.318034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:45839 (local address 127.1.81.195:36399)
0809 02:23:23.318187 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.318191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.318362 (+ 171us) server_negotiation.cc:407] Connection header received
0809 02:23:23.318509 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.318513 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.318563 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.318641 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:23.319057 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.319872 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.321600 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.322216 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.322334 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.322384 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.322588 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.322663 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 02:23:23.322855 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.317923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36399 (local address 127.1.81.193:45839)
0809 02:23:23.318280 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.318295 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.318405 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.318669 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.318672 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.318705 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:23.318952 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.318959 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.319963 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.319967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.321480 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.321492 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.322326 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.322330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.322454 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.322493 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.322568 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.322680 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":242,"spinlock_wait_cycles":7808,"thread_start_us":98,"threads_started":1}
I20260809 02:23:23.322858 23079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.317923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:38513 (local address 127.1.81.193:43385)
0809 02:23:23.318349 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.318359 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.318440 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.318664 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.318667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.318702 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:23.318952 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.318959 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.319963 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.319967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.321480 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.321492 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.322326 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.322330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.322451 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.322498 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.322568 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.322680 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":210,"spinlock_wait_cycles":11264,"thread_start_us":76,"threads_started":1}
I20260809 02:23:23.323570 22775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0639f4287a814bcca4f11c2917cd6831" candidate_uuid: "0534c788cf604a8f942f4e21f6869739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef31395791c341a483a9404b12d64c73" is_pre_election: true
I20260809 02:23:23.323772 22972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0639f4287a814bcca4f11c2917cd6831" candidate_uuid: "0534c788cf604a8f942f4e21f6869739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b045424110f41f09edcf4e0aee8e2d6" is_pre_election: true
I20260809 02:23:23.323918 22775 raft_consensus.cc:2454] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0534c788cf604a8f942f4e21f6869739 in term 0.
I20260809 02:23:23.324056 22972 raft_consensus.cc:2454] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0534c788cf604a8f942f4e21f6869739 in term 0.
I20260809 02:23:23.324388 22475 leader_election.cc:302] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0534c788cf604a8f942f4e21f6869739, ef31395791c341a483a9404b12d64c73; no voters:
I20260809 02:23:23.324699 23077 raft_consensus.cc:2781] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:23.324788 23077 raft_consensus.cc:482] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:23.324839 23077 raft_consensus.cc:3037] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:23.325943 23077 raft_consensus.cc:504] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.326254 23077 leader_election.cc:288] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [CANDIDATE]: Term 1 election: Requested vote from peers ef31395791c341a483a9404b12d64c73 (127.1.81.194:38513), 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399)
I20260809 02:23:23.326609 22972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0639f4287a814bcca4f11c2917cd6831" candidate_uuid: "0534c788cf604a8f942f4e21f6869739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b045424110f41f09edcf4e0aee8e2d6"
I20260809 02:23:23.326589 22775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0639f4287a814bcca4f11c2917cd6831" candidate_uuid: "0534c788cf604a8f942f4e21f6869739" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef31395791c341a483a9404b12d64c73"
I20260809 02:23:23.326716 22972 raft_consensus.cc:3037] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:23.326716 22775 raft_consensus.cc:3037] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:23.327958 22972 raft_consensus.cc:2454] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0534c788cf604a8f942f4e21f6869739 in term 1.
I20260809 02:23:23.327958 22775 raft_consensus.cc:2454] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0534c788cf604a8f942f4e21f6869739 in term 1.
I20260809 02:23:23.328238 22477 leader_election.cc:302] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0534c788cf604a8f942f4e21f6869739, 8b045424110f41f09edcf4e0aee8e2d6, ef31395791c341a483a9404b12d64c73; no voters:
I20260809 02:23:23.328408 23077 raft_consensus.cc:2781] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:23.328605 23077 raft_consensus.cc:686] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 1 LEADER]: Becoming Leader. State: Replica: 0534c788cf604a8f942f4e21f6869739, State: Running, Role: LEADER
I20260809 02:23:23.328917 23077 consensus_queue.cc:237] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.331722 22360 catalog_manager.cc:5495] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0534c788cf604a8f942f4e21f6869739 (127.1.81.193). New cstate: current_term: 1 leader_uuid: "0534c788cf604a8f942f4e21f6869739" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } health_report { overall_health: HEALTHY } } }
I20260809 02:23:23.368646 23064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.365635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34806 (local address 127.1.81.193:37445)
0809 02:23:23.365741 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.365744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.365758 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:23:23.365894 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.365896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.365946 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.366027 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:23.366197 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.366656 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.367424 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.367650 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.367729 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.367987 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:23.368353 (+ 366us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:23.368462 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.368502 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.368550 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:23:23.373862 22972 raft_consensus.cc:1261] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 1 FOLLOWER]: Refusing update from remote peer 0534c788cf604a8f942f4e21f6869739: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:23.373885 22775 raft_consensus.cc:1261] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Refusing update from remote peer 0534c788cf604a8f942f4e21f6869739: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:23.374528 23081 consensus_queue.cc:1035] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:23.374696 23077 consensus_queue.cc:1035] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:23.381745 23087 mvcc.cc:205] Tried to move back new op lower bound from 7316448065013456896 to 7316448064837681152. Current Snapshot: MvccSnapshot[applied={T|T < 7316448065013456896}]
I20260809 02:23:23.388415 22360 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:23.388576 22360 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:23.390815 22360 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Sending DeleteTablet for 3 replicas of tablet 0639f4287a814bcca4f11c2917cd6831
I20260809 02:23:23.391511 22937 tablet_service.cc:1514] Processing DeleteTablet for tablet 0639f4287a814bcca4f11c2917cd6831 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:23 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:47066
I20260809 02:23:23.391614 22744 tablet_service.cc:1514] Processing DeleteTablet for tablet 0639f4287a814bcca4f11c2917cd6831 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:23 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55426
I20260809 02:23:23.391644 22541 tablet_service.cc:1514] Processing DeleteTablet for tablet 0639f4287a814bcca4f11c2917cd6831 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:23 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:34804
I20260809 02:23:23.392127 23099 tablet_replica.cc:330] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: stopping tablet replica
I20260809 02:23:23.392374 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 22452
I20260809 02:23:23.392413 23099 raft_consensus.cc:2229] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:23:23.403101 23096 tablet_replica.cc:330] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: stopping tablet replica
I20260809 02:23:23.403101 23098 tablet_replica.cc:330] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: stopping tablet replica
I20260809 02:23:23.403388 23096 raft_consensus.cc:2229] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:23.403388 23098 raft_consensus.cc:2229] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:23.403678 23096 raft_consensus.cc:2258] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:23.403678 23098 raft_consensus.cc:2258] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:23.406214 23096 ts_tablet_manager.cc:1905] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:23.406365 23098 ts_tablet_manager.cc:1905] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:23.408478 23096 ts_tablet_manager.cc:1918] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:23.408571 23096 log.cc:1196] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/0639f4287a814bcca4f11c2917cd6831
I20260809 02:23:23.408862 23096 ts_tablet_manager.cc:1939] T 0639f4287a814bcca4f11c2917cd6831 P 8b045424110f41f09edcf4e0aee8e2d6: Deleting consensus metadata
I20260809 02:23:23.408996 23098 ts_tablet_manager.cc:1918] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:23.409096 23098 log.cc:1196] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/0639f4287a814bcca4f11c2917cd6831
I20260809 02:23:23.409363 23098 ts_tablet_manager.cc:1939] T 0639f4287a814bcca4f11c2917cd6831 P ef31395791c341a483a9404b12d64c73: Deleting consensus metadata
I20260809 02:23:23.409956 22344 catalog_manager.cc:4841] TS 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399): tablet 0639f4287a814bcca4f11c2917cd6831 (table test-table [id=e907e4491e114b3e82e9cb09dd1cf67e]) successfully deleted
I20260809 02:23:23.410471 22341 catalog_manager.cc:4841] TS ef31395791c341a483a9404b12d64c73 (127.1.81.194:38513): tablet 0639f4287a814bcca4f11c2917cd6831 (table test-table [id=e907e4491e114b3e82e9cb09dd1cf67e]) successfully deleted
W20260809 02:23:23.412755 22341 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:37445 (error 108)
I20260809 02:23:23.412981 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 22652
I20260809 02:23:23.415014 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.414718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37445 (local address 127.0.0.1:34814)
0809 02:23:23.414854 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.414930 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:37445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 02:23:23.415162 22341 catalog_manager.cc:4584] TS 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0639f4287a814bcca4f11c2917cd6831: Network error: Client connection negotiation failed: client connection to 127.1.81.193:37445: connect: Connection refused (error 111)
I20260809 02:23:23.423113 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 22846
I20260809 02:23:23.434549 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 22322
I20260809 02:23:23.445443 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43585
--webserver_interface=127.1.81.254
--webserver_port=33339
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:43585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:23.550732 23102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:23.550951 23102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:23.551005 23102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:23.555163 23102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:23.555224 23102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:23.555250 23102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:23.555272 23102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:23.555301 23102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:23.560297 23102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:43585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=33339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:23.561154 23102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:23.562013 23102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:23.574357 23114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:23.574342 23117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:23.574448 23102 server_base.cc:1034] running on GCE node
W20260809 02:23:23.574368 23113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:23.575124 23102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:23.576156 23102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:23.577307 23102 hybrid_clock.cc:648] HybridClock initialized: now 1786242203577283 us; error 37 us; skew 500 ppm
Aug 09 02:23:23 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242203, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:23.579890 23102 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:23:23.580677 23102 webserver.cc:460] Webserver started at http://127.1.81.254:33339/ using document root <none> and password file <none>
I20260809 02:23:23.581174 23102 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:23.581255 23102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:23.584729 23102 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:23:23.586599 23125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:23.587695 23102 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:23.587836 23102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "7f85700440f1476994ed6a288dc019e3"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "e2f249afa4903ad8178db5ba7845dfe5"
server_key_iv: "139feb9f77e84cd156b299e869fca7fd"
server_key_version: "encryptionkey@0"
I20260809 02:23:23.588351 23102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:23.599505 23102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:23.602252 23102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:23.602413 23102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:23.608682 23102 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:43585
I20260809 02:23:23.608923 23192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:43585 every 8 connection(s)
I20260809 02:23:23.609635 23102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:23.610903 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 23102
I20260809 02:23:23.611299 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:37445
--local_ip_for_outbound_sockets=127.1.81.193
--tserver_master_addrs=127.1.81.254:43585
--webserver_port=36805
--webserver_interface=127.1.81.193
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:23.614158 23193 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:23:23.615773 23193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Bootstrap starting.
I20260809 02:23:23.632586 23193 log.cc:824] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:23.640641 23193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:23:23.640938 23193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Bootstrap complete.
I20260809 02:23:23.644690 23193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:23.645038 23193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f85700440f1476994ed6a288dc019e3, State: Initialized, Role: FOLLOWER
I20260809 02:23:23.645490 23193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:23.645605 23193 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:23.645674 23193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:23.645761 23193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:23:23.647472 23193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:23.647768 23193 leader_election.cc:302] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f85700440f1476994ed6a288dc019e3; no voters:
I20260809 02:23:23.648099 23193 leader_election.cc:288] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:23:23.648191 23197 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:23:23.648360 23197 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 2 LEADER]: Becoming Leader. State: Replica: 7f85700440f1476994ed6a288dc019e3, State: Running, Role: LEADER
I20260809 02:23:23.648636 23197 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:23.649262 23193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:23.649529 23197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f85700440f1476994ed6a288dc019e3. Latest consensus state: current_term: 2 leader_uuid: "7f85700440f1476994ed6a288dc019e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } } }
I20260809 02:23:23.649729 23197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:23.650347 23198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7f85700440f1476994ed6a288dc019e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } } }
I20260809 02:23:23.650511 23198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:23.651238 23202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:23.655546 23202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:23.656222 23202 catalog_manager.cc:1259] Loaded cluster ID: 03787d4c1fe24f75be0e407b01dcca33
I20260809 02:23:23.656283 23202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:23.657689 23202 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 02:23:23.662403 23202 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 02:23:23.667181 23202 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:23.667896 23202 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Loaded TSK: 0
I20260809 02:23:23.668992 23202 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:23:23.719486 23195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:23.719704 23195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:23.719760 23195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:23.723595 23195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:23.723650 23195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:23.723726 23195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:23:23.728739 23195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:37445
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=36805
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:23.729665 23195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:23.730597 23195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:23.740592 23233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:23.740628 23235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:23.740589 23232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:23.740854 23195 server_base.cc:1034] running on GCE node
I20260809 02:23:23.741377 23195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:23.741933 23195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:23.743109 23195 hybrid_clock.cc:648] HybridClock initialized: now 1786242203743088 us; error 34 us; skew 500 ppm
Aug 09 02:23:23 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242203, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:23.745651 23195 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:23:23.746460 23195 webserver.cc:460] Webserver started at http://127.1.81.193:36805/ using document root <none> and password file <none>
I20260809 02:23:23.746944 23195 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:23.747014 23195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:23.750715 23195 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:23.752804 23247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:23.753937 23195 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:23.754027 23195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "0534c788cf604a8f942f4e21f6869739"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "1d5976b7a6f9f3cb65868e4e4941268a"
server_key_iv: "9f47f9f21a7bf2936c0bf16306c52486"
server_key_version: "encryptionkey@0"
I20260809 02:23:23.754524 23195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:23.778049 23195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:23.780911 23195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:23.781070 23195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:23.781687 23195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:23.782945 23261 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:23:23.787127 23195 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:23:23.787187 23195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260809 02:23:23.787233 23195 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:23:23.788887 23195 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:23:23.788945 23195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:23.789222 23261 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Bootstrap starting.
I20260809 02:23:23.799536 23195 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:37445
I20260809 02:23:23.799551 23424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:37445 every 8 connection(s)
I20260809 02:23:23.800804 23195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:23.808203 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 23195
I20260809 02:23:23.808679 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:38513
--local_ip_for_outbound_sockets=127.1.81.194
--tserver_master_addrs=127.1.81.254:43585
--webserver_port=45235
--webserver_interface=127.1.81.194
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:23.809954 23261 log.cc:824] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:23:23 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242203, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:23.816833 23429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.802830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:43017)
0809 02:23:23.803334 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.803375 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.804169 (+ 794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.805207 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.805215 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.805598 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:23.806017 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.806030 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.807293 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.807296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.808203 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.808213 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.809015 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.809020 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.809200 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.809729 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:23.809745 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:23.811238 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:23.813561 (+ 2323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:23.813566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:23.813579 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:23.813898 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:23.814320 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:23.814323 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:23.814325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:23.814489 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:23.815183 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:23.815188 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:23.815441 (+ 253us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.815621 (+ 180us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.815951 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":163,"threads_started":1}
I20260809 02:23:23.817226 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.802762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:43017 (local address 127.1.81.254:43585)
0809 02:23:23.803097 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.803117 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.803485 (+ 368us) server_negotiation.cc:407] Connection header received
0809 02:23:23.804546 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.804556 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.804833 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.805117 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:23.806182 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.807134 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.808363 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.808846 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.808996 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.811420 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:23.811425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:23.811436 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:23.811463 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:23.813429 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.814028 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.814035 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.814041 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.814207 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.814589 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.814593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.814595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.815057 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:23.815199 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.815782 (+ 583us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.816108 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":108,"threads_started":1}
I20260809 02:23:23.818564 23261 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:23:23.818895 23261 tablet_bootstrap.cc:492] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Bootstrap complete.
I20260809 02:23:23.819731 23426 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43585
I20260809 02:23:23.819980 23426 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:23.820104 23261 ts_tablet_manager.cc:1397] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.015s
I20260809 02:23:23.820494 23426 heartbeater.cc:511] Master 127.1.81.254:43585 requested a full tablet report, sending...
I20260809 02:23:23.822499 23261 raft_consensus.cc:348] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.822871 23261 raft_consensus.cc:729] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0534c788cf604a8f942f4e21f6869739, State: Initialized, Role: FOLLOWER
I20260809 02:23:23.823043 23146 ts_manager.cc:194] Registered new tserver with Master: 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445)
I20260809 02:23:23.823279 23261 consensus_queue.cc:260] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:23.824117 23261 ts_tablet_manager.cc:1428] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260809 02:23:23.827168 23146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:43017
I20260809 02:23:23.829470 23426 heartbeater.cc:503] Master 127.1.81.254:43585 was elected leader, sending a full tablet report...
Aug 09 02:23:23 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242203, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:23:23.836314 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.826087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37445 (local address 127.0.0.1:34820)
0809 02:23:23.826430 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.826470 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.826579 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.828399 (+ 1820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.828405 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.828806 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:23.828924 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.828931 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.830094 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.830098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.830701 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.830709 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.831337 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.831341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.831448 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.831962 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:23.831973 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:23.833198 (+ 1225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:23.834749 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:23.834758 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:23.834763 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:23.834964 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:23.835237 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:23.835240 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:23.835242 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:23.835316 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:23.835716 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:23.835721 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:23.835859 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.835982 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.836154 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":87,"threads_started":1}
I20260809 02:23:23.836360 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.826154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34820 (local address 127.1.81.193:37445)
0809 02:23:23.828001 (+ 1847us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.828012 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.828034 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:23:23.828093 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.828097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.828247 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.828374 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:23.829048 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.830000 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.830811 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.831229 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.831321 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.833322 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:23.833330 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:23.833342 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:23.833363 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:23.834651 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.835065 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.835078 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.835079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.835153 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.835395 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.835398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.835400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.835610 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:23.835719 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.836083 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.836227 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1757,"thread_start_us":90,"threads_started":1}
I20260809 02:23:23.837205 23327 tablet_service.cc:1514] Processing DeleteTablet for tablet 0639f4287a814bcca4f11c2917cd6831 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:23 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:34820
I20260809 02:23:23.838066 23436 tablet_replica.cc:330] stopping tablet replica
I20260809 02:23:23.838318 23436 raft_consensus.cc:2229] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:23.838515 23436 raft_consensus.cc:2258] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:23.839299 23436 ts_tablet_manager.cc:1905] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:23.842489 23436 ts_tablet_manager.cc:1918] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:23.842573 23436 log.cc:1196] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/0639f4287a814bcca4f11c2917cd6831
I20260809 02:23:23.842808 23436 ts_tablet_manager.cc:1939] T 0639f4287a814bcca4f11c2917cd6831 P 0534c788cf604a8f942f4e21f6869739: Deleting consensus metadata
I20260809 02:23:23.844290 23127 catalog_manager.cc:4841] TS 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445): tablet 0639f4287a814bcca4f11c2917cd6831 (table test-table [id=e907e4491e114b3e82e9cb09dd1cf67e]) successfully deleted
W20260809 02:23:23.923072 23431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:23.923285 23431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:23.923329 23431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:23.927177 23431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:23.927227 23431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:23.927307 23431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:23:23.932243 23431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:38513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=45235
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:23.933079 23431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:23.933965 23431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:23.942692 23448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:23.942721 23450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:23.942688 23447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:23.942909 23431 server_base.cc:1034] running on GCE node
I20260809 02:23:23.943337 23431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:23.943938 23431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:23.945094 23431 hybrid_clock.cc:648] HybridClock initialized: now 1786242203945075 us; error 28 us; skew 500 ppm
Aug 09 02:23:23 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242203, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:23.947580 23431 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:23:23.948391 23431 webserver.cc:460] Webserver started at http://127.1.81.194:45235/ using document root <none> and password file <none>
I20260809 02:23:23.948875 23431 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:23.948956 23431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:23.952659 23431 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:23.954488 23461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:23.955562 23431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:23.955672 23431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "ef31395791c341a483a9404b12d64c73"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "767f14f2ac435581eca16955b8dc3e88"
server_key_iv: "8af01894a3d946714225bee3da3975ca"
server_key_version: "encryptionkey@0"
I20260809 02:23:23.956166 23431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:23.966801 23431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:23.969213 23431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:23.969362 23431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:23.969852 23431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:23.970585 23431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:23.970636 23431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:23.970685 23431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:23.970710 23431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:23.979184 23431 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:38513
I20260809 02:23:23.979235 23624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:38513 every 8 connection(s)
I20260809 02:23:23.980108 23431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:23:23 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242203, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:23.988631 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 23431
I20260809 02:23:23.989064 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:36399
--local_ip_for_outbound_sockets=127.1.81.195
--tserver_master_addrs=127.1.81.254:43585
--webserver_port=38863
--webserver_interface=127.1.81.195
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:23.992453 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.981597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:39737 (local address 127.1.81.254:43585)
0809 02:23:23.981708 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:23.981712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:23.982422 (+ 710us) server_negotiation.cc:407] Connection header received
0809 02:23:23.983553 (+ 1131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:23.983556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:23.983614 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:23.983683 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:23.984707 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.985223 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.986212 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.986425 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.986489 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.988907 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:23.988913 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:23.988915 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:23.988945 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:23.990383 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.990873 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.990878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.990879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.990969 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:23.991322 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:23.991325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:23.991327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:23.991513 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:23.991616 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:23.992111 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 02:23:23.992293 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:23:23.993088 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:23.981880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:39737)
0809 02:23:23.982283 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:23.982321 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:23.983383 (+ 1062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:23.983838 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:23.983847 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:23.984175 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:23.984579 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.984591 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.985307 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.985309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.986118 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:23.986126 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:23.986521 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:23.986523 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:23.986652 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:23.987131 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:23.987158 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:23.988646 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:23.990505 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:23.990509 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:23.990519 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:23.990782 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:23.991051 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:23.991054 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:23.991056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:23.991234 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:23.991630 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:23.991636 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:23.991882 (+ 246us) client_negotiation.cc:769] Sending connection context
0809 02:23:23.992051 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 02:23:23.992347 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":113,"threads_started":1}
I20260809 02:23:23.994104 23628 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43585
I20260809 02:23:23.994309 23628 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:23.994728 23628 heartbeater.cc:511] Master 127.1.81.254:43585 requested a full tablet report, sending...
I20260809 02:23:23.995689 23146 ts_manager.cc:194] Registered new tserver with Master: ef31395791c341a483a9404b12d64c73 (127.1.81.194:38513)
I20260809 02:23:23.996454 23146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:39737
W20260809 02:23:24.097075 23631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:24.097289 23631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:24.097328 23631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:24.101125 23631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:24.101171 23631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:24.101223 23631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:23:24.106161 23631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:36399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=38863
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:24.106946 23631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:24.107769 23631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:24.116258 23640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.116214 23638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.116216 23642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:24.116565 23631 server_base.cc:1034] running on GCE node
I20260809 02:23:24.116918 23631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:24.117446 23631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:24.118589 23631 hybrid_clock.cc:648] HybridClock initialized: now 1786242204118571 us; error 30 us; skew 500 ppm
Aug 09 02:23:24 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:24.121080 23631 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:23:24.121814 23631 webserver.cc:460] Webserver started at http://127.1.81.195:38863/ using document root <none> and password file <none>
I20260809 02:23:24.122259 23631 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:24.122321 23631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:24.125723 23631 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:23:24.127514 23658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:24.128618 23631 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:23:24.128712 23631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "8b045424110f41f09edcf4e0aee8e2d6"
format_stamp: "Formatted at 2026-08-09 02:23:23 on dist-test-slave-jlzn"
server_key: "12a3dda555630e823efc9a0c17e61445"
server_key_iv: "7efefb70d11ff07b06f8607a45d58441"
server_key_version: "encryptionkey@0"
I20260809 02:23:24.129155 23631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:24.146065 23631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:24.148407 23631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:24.148540 23631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:24.149077 23631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:24.149785 23631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:24.149832 23631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:24.149866 23631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:24.149886 23631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:24.158123 23631 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:36399
I20260809 02:23:24.158151 23817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:36399 every 8 connection(s)
I20260809 02:23:24.158974 23631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:24.166314 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 23631
Aug 09 02:23:24 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:24.171203 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.160557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:48803 (local address 127.1.81.254:43585)
0809 02:23:24.160725 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.160730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.161469 (+ 739us) server_negotiation.cc:407] Connection header received
0809 02:23:24.162594 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.162601 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.162648 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.162715 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:24.163690 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.164232 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.165298 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.165517 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.165609 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.167795 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:24.167827 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:24.167831 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:24.167856 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:24.169364 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:24.169885 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:24.169888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:24.169889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:24.169962 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:24.170303 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:24.170305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:24.170306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:24.170453 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:24.170519 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.170984 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.171080 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 02:23:24.172159 23824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.160922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:48803)
0809 02:23:24.161334 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.161372 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:24.162426 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:24.162847 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:24.162853 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:24.163175 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:24.163581 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.163593 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.164324 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.164327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.165191 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.165201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.165626 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.165629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.165750 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.166231 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:24.166247 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:24.167660 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:24.169468 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:24.169473 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:24.169483 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:24.169790 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:24.170041 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:24.170044 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:24.170046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:24.170221 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:24.170538 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:24.170543 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:24.170759 (+ 216us) client_negotiation.cc:769] Sending connection context
0809 02:23:24.170915 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 02:23:24.171222 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":117,"threads_started":1}
I20260809 02:23:24.173290 23820 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43585
I20260809 02:23:24.173520 23820 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:24.174044 23820 heartbeater.cc:511] Master 127.1.81.254:43585 requested a full tablet report, sending...
I20260809 02:23:24.175094 23146 ts_manager.cc:194] Registered new tserver with Master: 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399)
I20260809 02:23:24.175458 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.167191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50204 (local address 127.1.81.254:43585)
0809 02:23:24.167409 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.167412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.167424 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:23:24.167836 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.167839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.167878 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.167968 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:24.168768 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.169526 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.170605 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.170815 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.170888 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.172231 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:24.172235 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:24.172237 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:24.172262 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:24.173893 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:24.174325 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:24.174329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:24.174331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:24.174421 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:24.174682 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:24.174685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:24.174686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:24.174844 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:24.175043 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.175201 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.175308 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"spinlock_wait_cycles":6400,"thread_start_us":65,"threads_started":1}
I20260809 02:23:24.175772 23146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:48803
I20260809 02:23:24.177043 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:24.180506 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.177620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50210 (local address 127.1.81.254:43585)
0809 02:23:24.177721 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.177725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.177878 (+ 153us) server_negotiation.cc:407] Connection header received
0809 02:23:24.177989 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.177991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.178064 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.178135 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:24.178280 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.178723 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.179472 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.179672 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.179739 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.179962 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:24.180261 (+ 299us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:24.180341 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.180381 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.180424 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:23:24.181031 23146 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50210:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:24.184073 23146 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:24.191275 23327 tablet_service.cc:1467] Processing CreateTablet for tablet 1cb31bae28d54802b0f867c96ad4768c (DEFAULT_TABLE table=test-table [id=f1c56b1ee49e4b9590d8e0391410a192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:24.191869 23327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cb31bae28d54802b0f867c96ad4768c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:24.194459 23261 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Bootstrap starting.
I20260809 02:23:24.195233 23261 tablet_bootstrap.cc:654] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:24.195930 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.190200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:38513 (local address 127.0.0.1:55432)
0809 02:23:24.190316 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.190330 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:24.190402 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:24.191517 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:24.191520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:24.191553 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:24.191633 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.191639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.193086 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.193090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.194266 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.194276 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.195527 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.195530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.195620 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.195667 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 02:23:24.195714 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 02:23:24.195787 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":3}
I20260809 02:23:24.196216 23835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.190661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36399 (local address 127.0.0.1:47072)
0809 02:23:24.190869 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.190882 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:24.190962 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:24.191659 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:24.191661 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:24.191723 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:24.191794 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.191821 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.193333 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.193336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.194410 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.194418 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.195864 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.195868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.195948 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.195971 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:23:24.196032 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 02:23:24.196096 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":2,"thread_start_us":67,"threads_started":1}
I20260809 02:23:24.196635 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.190371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55432 (local address 127.1.81.194:38513)
0809 02:23:24.191011 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.191023 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.191046 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:23:24.191126 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.191131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.191354 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.191786 (+ 432us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:24.192052 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.192977 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.194547 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.195388 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.196188 (+ 800us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.196340 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.196393 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.196484 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":145,"threads_started":1}
I20260809 02:23:24.196732 23261 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: No bootstrap required, opened a new log
I20260809 02:23:24.196787 23836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.190786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47072 (local address 127.1.81.195:36399)
0809 02:23:24.191134 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.191143 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.191161 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:23:24.191213 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.191218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.191351 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.191496 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:24.191928 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.193196 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.194581 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.195608 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.195719 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.196529 (+ 810us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.196576 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.196663 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":113,"threads_started":1}
I20260809 02:23:24.196816 23261 ts_tablet_manager.cc:1397] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:24.197194 23261 raft_consensus.cc:348] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.197293 23261 raft_consensus.cc:374] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:24.197329 23261 raft_consensus.cc:729] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0534c788cf604a8f942f4e21f6869739, State: Initialized, Role: FOLLOWER
I20260809 02:23:24.197451 23261 consensus_queue.cc:260] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.197691 23261 ts_tablet_manager.cc:1428] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:24.199405 23726 tablet_service.cc:1467] Processing CreateTablet for tablet 1cb31bae28d54802b0f867c96ad4768c (DEFAULT_TABLE table=test-table [id=f1c56b1ee49e4b9590d8e0391410a192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:24.199393 23531 tablet_service.cc:1467] Processing CreateTablet for tablet 1cb31bae28d54802b0f867c96ad4768c (DEFAULT_TABLE table=test-table [id=f1c56b1ee49e4b9590d8e0391410a192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:24.200448 23531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cb31bae28d54802b0f867c96ad4768c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:24.200454 23726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cb31bae28d54802b0f867c96ad4768c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:24.208354 23838 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Bootstrap starting.
I20260809 02:23:24.208501 23839 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Bootstrap starting.
I20260809 02:23:24.211063 23838 tablet_bootstrap.cc:654] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:24.211063 23839 tablet_bootstrap.cc:654] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:24.212000 23838 log.cc:824] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:24.212000 23839 log.cc:824] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:24.213778 23838 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: No bootstrap required, opened a new log
I20260809 02:23:24.213779 23839 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: No bootstrap required, opened a new log
I20260809 02:23:24.213948 23838 ts_tablet_manager.cc:1397] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:23:24.213951 23839 ts_tablet_manager.cc:1397] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:23:24.216679 23838 raft_consensus.cc:348] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.216674 23839 raft_consensus.cc:348] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.216876 23838 raft_consensus.cc:374] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:24.216879 23839 raft_consensus.cc:374] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:24.216910 23838 raft_consensus.cc:729] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef31395791c341a483a9404b12d64c73, State: Initialized, Role: FOLLOWER
I20260809 02:23:24.216924 23839 raft_consensus.cc:729] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b045424110f41f09edcf4e0aee8e2d6, State: Initialized, Role: FOLLOWER
I20260809 02:23:24.217288 23838 consensus_queue.cc:260] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.217293 23839 consensus_queue.cc:260] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.217913 23628 heartbeater.cc:503] Master 127.1.81.254:43585 was elected leader, sending a full tablet report...
I20260809 02:23:24.218152 23820 heartbeater.cc:503] Master 127.1.81.254:43585 was elected leader, sending a full tablet report...
I20260809 02:23:24.218169 23838 ts_tablet_manager.cc:1428] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 02:23:24.218199 23839 ts_tablet_manager.cc:1428] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260809 02:23:24.230885 23629 tablet.cc:2369] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:24.240464 23843 raft_consensus.cc:482] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:24.240586 23843 raft_consensus.cc:504] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.241446 23843 leader_election.cc:288] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399), 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445)
I20260809 02:23:24.244944 23836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.241711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:36089 (local address 127.1.81.195:36399)
0809 02:23:24.241822 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.241827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.241932 (+ 105us) server_negotiation.cc:407] Connection header received
0809 02:23:24.242043 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.242045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.242081 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.242139 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:24.242387 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.242863 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.243926 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.244446 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.244565 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.244614 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.244802 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.244854 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:23:24.244977 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.241623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36399 (local address 127.1.81.194:36089)
0809 02:23:24.241846 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.241860 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:24.241945 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:24.242172 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:24.242174 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:24.242191 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:24.242289 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.242293 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.242969 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.242973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.243779 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.243791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.244570 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.244574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.244685 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.244711 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:23:24.244789 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:23:24.244855 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260809 02:23:24.245654 23848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.241689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37445 (local address 127.1.81.194:50853)
0809 02:23:24.241994 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.242006 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:24.242101 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:24.242355 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:24.242357 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:24.242373 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:24.242486 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.242491 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.243252 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.243256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.244219 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:24.244230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.245325 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.245329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:24.245428 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.245448 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:23:24.245505 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 02:23:24.245553 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":102,"threads_started":1}
I20260809 02:23:24.245632 23754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb31bae28d54802b0f867c96ad4768c" candidate_uuid: "ef31395791c341a483a9404b12d64c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b045424110f41f09edcf4e0aee8e2d6" is_pre_election: true
I20260809 02:23:24.245743 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.241793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:50853 (local address 127.1.81.193:37445)
0809 02:23:24.241922 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.241926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.242079 (+ 153us) server_negotiation.cc:407] Connection header received
0809 02:23:24.242206 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.242209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.242259 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.242333 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:24.242585 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.243135 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.244362 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.244986 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.245076 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.245211 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.245550 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.245632 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:23:24.245888 23754 raft_consensus.cc:2454] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef31395791c341a483a9404b12d64c73 in term 0.
I20260809 02:23:24.246222 23356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb31bae28d54802b0f867c96ad4768c" candidate_uuid: "ef31395791c341a483a9404b12d64c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0534c788cf604a8f942f4e21f6869739" is_pre_election: true
I20260809 02:23:24.246332 23465 leader_election.cc:302] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b045424110f41f09edcf4e0aee8e2d6, ef31395791c341a483a9404b12d64c73; no voters:
I20260809 02:23:24.246451 23356 raft_consensus.cc:2454] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef31395791c341a483a9404b12d64c73 in term 0.
I20260809 02:23:24.246593 23843 raft_consensus.cc:2781] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:24.246693 23843 raft_consensus.cc:482] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:24.246747 23843 raft_consensus.cc:3037] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:24.247761 23843 raft_consensus.cc:504] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.248097 23843 leader_election.cc:288] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 1 election: Requested vote from peers 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399), 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445)
I20260809 02:23:24.248399 23754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb31bae28d54802b0f867c96ad4768c" candidate_uuid: "ef31395791c341a483a9404b12d64c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b045424110f41f09edcf4e0aee8e2d6"
I20260809 02:23:24.248509 23754 raft_consensus.cc:3037] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:24.248528 23356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb31bae28d54802b0f867c96ad4768c" candidate_uuid: "ef31395791c341a483a9404b12d64c73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0534c788cf604a8f942f4e21f6869739"
I20260809 02:23:24.248643 23356 raft_consensus.cc:3037] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:24.249722 23754 raft_consensus.cc:2454] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef31395791c341a483a9404b12d64c73 in term 1.
I20260809 02:23:24.249778 23356 raft_consensus.cc:2454] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef31395791c341a483a9404b12d64c73 in term 1.
I20260809 02:23:24.250015 23465 leader_election.cc:302] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b045424110f41f09edcf4e0aee8e2d6, ef31395791c341a483a9404b12d64c73; no voters:
I20260809 02:23:24.250228 23843 raft_consensus.cc:2781] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:24.250438 23843 raft_consensus.cc:686] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 LEADER]: Becoming Leader. State: Replica: ef31395791c341a483a9404b12d64c73, State: Running, Role: LEADER
I20260809 02:23:24.250701 23843 consensus_queue.cc:237] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.253419 23146 catalog_manager.cc:5495] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef31395791c341a483a9404b12d64c73 (127.1.81.194). New cstate: current_term: 1 leader_uuid: "ef31395791c341a483a9404b12d64c73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } health_report { overall_health: UNKNOWN } } }
I20260809 02:23:24.263638 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.260969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55438 (local address 127.1.81.194:38513)
0809 02:23:24.261081 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.261084 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.261096 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:23:24.261218 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.261220 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.261262 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.261336 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:24.261471 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.261905 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.262613 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.262803 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.262864 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.263059 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:24.263389 (+ 330us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:24.263469 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.263495 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.263535 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:23:24.268460 23356 raft_consensus.cc:1261] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Refusing update from remote peer ef31395791c341a483a9404b12d64c73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:24.268463 23754 raft_consensus.cc:1261] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 1 FOLLOWER]: Refusing update from remote peer ef31395791c341a483a9404b12d64c73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:24.269011 23849 consensus_queue.cc:1035] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:24.269186 23843 consensus_queue.cc:1035] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:24.281899 23144 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:24.282028 23144 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:24.284142 23144 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Sending DeleteTablet for 3 replicas of tablet 1cb31bae28d54802b0f867c96ad4768c
I20260809 02:23:24.284786 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 23195
I20260809 02:23:24.284801 23327 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cb31bae28d54802b0f867c96ad4768c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:24 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:34820
I20260809 02:23:24.284811 23726 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cb31bae28d54802b0f867c96ad4768c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:24 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:47072
I20260809 02:23:24.284986 23531 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cb31bae28d54802b0f867c96ad4768c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:24 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55432
I20260809 02:23:24.285135 23436 tablet_replica.cc:330] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: stopping tablet replica
I20260809 02:23:24.285437 23866 tablet_replica.cc:330] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: stopping tablet replica
I20260809 02:23:24.285696 23866 raft_consensus.cc:2229] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:24.285959 23866 raft_consensus.cc:2258] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:24.289451 23866 ts_tablet_manager.cc:1905] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:24.292343 23866 ts_tablet_manager.cc:1918] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:24.292452 23866 log.cc:1196] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/1cb31bae28d54802b0f867c96ad4768c
I20260809 02:23:24.292856 23866 ts_tablet_manager.cc:1939] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Deleting consensus metadata
I20260809 02:23:24.294114 23129 catalog_manager.cc:4841] TS 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399): tablet 1cb31bae28d54802b0f867c96ad4768c (table test-table [id=f1c56b1ee49e4b9590d8e0391410a192]) successfully deleted
W20260809 02:23:24.299276 23127 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:37445 (error 108)
I20260809 02:23:24.299625 23867 tablet_replica.cc:330] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: stopping tablet replica
I20260809 02:23:24.299821 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 23431
I20260809 02:23:24.301568 23835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.301263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37445 (local address 127.0.0.1:34828)
0809 02:23:24.301421 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.301486 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:37445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260809 02:23:24.301716 23127 catalog_manager.cc:4584] TS 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1cb31bae28d54802b0f867c96ad4768c: Network error: Client connection negotiation failed: client connection to 127.1.81.193:37445: connect: Connection refused (error 111)
I20260809 02:23:24.309737 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 23631
I20260809 02:23:24.310082 23835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.309834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:38513 (local address 127.0.0.1:55452)
0809 02:23:24.309971 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.310012 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.194:38513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 02:23:24.318493 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 23102
I20260809 02:23:24.327198 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43585
--webserver_interface=127.1.81.254
--webserver_port=33339
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:43585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:24.433725 23870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:24.433951 23870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:24.434006 23870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:24.437861 23870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:24.437909 23870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:24.437935 23870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:24.437955 23870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:24.437983 23870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:24.442873 23870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:43585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=33339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:24.443735 23870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:24.444634 23870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:24.452270 23875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.452279 23879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.452345 23876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:24.452548 23870 server_base.cc:1034] running on GCE node
I20260809 02:23:24.453112 23870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:24.454058 23870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:24.455220 23870 hybrid_clock.cc:648] HybridClock initialized: now 1786242204455202 us; error 28 us; skew 500 ppm
Aug 09 02:23:24 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:24.457731 23870 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:23:24.458534 23870 webserver.cc:460] Webserver started at http://127.1.81.254:33339/ using document root <none> and password file <none>
I20260809 02:23:24.459020 23870 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:24.459096 23870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:24.462597 23870 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:24.464510 23890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:24.465582 23870 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:24.465692 23870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "7f85700440f1476994ed6a288dc019e3"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "e2f249afa4903ad8178db5ba7845dfe5"
server_key_iv: "139feb9f77e84cd156b299e869fca7fd"
server_key_version: "encryptionkey@0"
I20260809 02:23:24.466159 23870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:24.497327 23870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:24.500092 23870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:24.500260 23870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:24.506706 23870 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:43585
I20260809 02:23:24.506949 23967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:43585 every 8 connection(s)
I20260809 02:23:24.507666 23870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:24.511559 23968 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:23:24.512873 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 23870
I20260809 02:23:24.513281 23968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Bootstrap starting.
I20260809 02:23:24.513336 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:37445
--local_ip_for_outbound_sockets=127.1.81.193
--tserver_master_addrs=127.1.81.254:43585
--webserver_port=36805
--webserver_interface=127.1.81.193
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:24.531178 23968 log.cc:824] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:24.542135 23968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:23:24.542457 23968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3: Bootstrap complete.
I20260809 02:23:24.546200 23968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:24.546556 23968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f85700440f1476994ed6a288dc019e3, State: Initialized, Role: FOLLOWER
I20260809 02:23:24.547015 23968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:24.547132 23968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:24.547201 23968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:24.547288 23968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:23:24.549069 23968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:24.549372 23968 leader_election.cc:302] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f85700440f1476994ed6a288dc019e3; no voters:
I20260809 02:23:24.549644 23968 leader_election.cc:288] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 02:23:24.549741 23975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:23:24.549932 23975 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [term 3 LEADER]: Becoming Leader. State: Replica: 7f85700440f1476994ed6a288dc019e3, State: Running, Role: LEADER
I20260809 02:23:24.550215 23975 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } }
I20260809 02:23:24.550794 23968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:24.551141 23977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f85700440f1476994ed6a288dc019e3. Latest consensus state: current_term: 3 leader_uuid: "7f85700440f1476994ed6a288dc019e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } } }
I20260809 02:23:24.551270 23977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:24.551494 23976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7f85700440f1476994ed6a288dc019e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f85700440f1476994ed6a288dc019e3" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43585 } } }
I20260809 02:23:24.551606 23976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f85700440f1476994ed6a288dc019e3 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:24.551666 23980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:24.556638 23980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:24.557297 23980 catalog_manager.cc:1259] Loaded cluster ID: 03787d4c1fe24f75be0e407b01dcca33
I20260809 02:23:24.557356 23980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 02:23:24.558475 23980 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2545d749ad google::LogMessage::Fail() at ??:0
@ 0x7f2545d7788a google::LogMessage::SendToLog() at ??:0
@ 0x7f2545d744de google::LogMessage::Flush() at ??:0
@ 0x7f2545d75a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f25506b3fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f25506b4d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f25506b1579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f25506f5640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2547fc63d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2547fc6c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f2547fc83f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2547fb7512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f25495fb6db start_thread at ??:0
@ 0x7f254487261f clone at ??:0
W20260809 02:23:24.642596 23971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:24.642910 23971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:24.642994 23971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:24.648823 23971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:24.648890 23971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:24.648979 23971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:23:24.656294 23971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:37445
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=36805
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:24.657464 23971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:24.658726 23971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:24.669237 24036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.669270 24041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.669227 24035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:24.669919 23971 server_base.cc:1034] running on GCE node
I20260809 02:23:24.670343 23971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:24.671078 23971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:24.672286 23971 hybrid_clock.cc:648] HybridClock initialized: now 1786242204672263 us; error 36 us; skew 500 ppm
Aug 09 02:23:24 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:24.677479 23971 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:23:24.678231 23971 webserver.cc:460] Webserver started at http://127.1.81.193:36805/ using document root <none> and password file <none>
I20260809 02:23:24.678726 23971 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:24.678791 23971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:24.682446 23971 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:24.684562 24052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:24.685782 23971 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:24.685886 23971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "0534c788cf604a8f942f4e21f6869739"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "1d5976b7a6f9f3cb65868e4e4941268a"
server_key_iv: "9f47f9f21a7bf2936c0bf16306c52486"
server_key_version: "encryptionkey@0"
I20260809 02:23:24.686353 23971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:24.705520 23971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:24.708318 23971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:24.708478 23971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:24.708988 23971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:24.709992 24063 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:23:24.715198 23971 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:23:24.715252 23971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 02:23:24.715315 23971 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:23:24.716848 23971 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:23:24.716893 23971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:24.717250 24063 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Bootstrap starting.
I20260809 02:23:24.726807 23971 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:37445
I20260809 02:23:24.727034 24227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:37445 every 8 connection(s)
I20260809 02:23:24.727717 23971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:24.730588 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 23971
I20260809 02:23:24.731052 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:38513
--local_ip_for_outbound_sockets=127.1.81.194
--tserver_master_addrs=127.1.81.254:43585
--webserver_port=45235
--webserver_interface=127.1.81.194
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:24.739673 24063 log.cc:824] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:24.748152 24063 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:23:24.748530 24063 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Bootstrap complete.
I20260809 02:23:24.749971 24063 ts_tablet_manager.cc:1397] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.008s
I20260809 02:23:24.752796 24063 raft_consensus.cc:348] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.753324 24063 raft_consensus.cc:729] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0534c788cf604a8f942f4e21f6869739, State: Initialized, Role: FOLLOWER
I20260809 02:23:24.753808 24063 consensus_queue.cc:260] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.754886 24063 ts_tablet_manager.cc:1428] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260809 02:23:24.838495 24231 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:24.729436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:34187)
0809 02:23:24.729880 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.729930 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:24.730917 (+ 987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:24.837535 (+106618us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":128,"threads_started":1}
W20260809 02:23:24.839095 24229 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:43585 (0 consecutive failures): Network error: Failed to ping master at 127.1.81.254:43585: Client connection negotiation failed: client connection to 127.1.81.254:43585: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:23:24.839847 24231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.839546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:33913)
0809 02:23:24.839685 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.839760 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 02:23:24.840500 24231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.840289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:58487)
0809 02:23:24.840392 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.840443 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 02:23:24.840729 24229 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:23:24.846102 24232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:24.846306 24232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:24.846345 24232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:24.850190 24232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:24.850235 24232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:24.850289 24232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:23:24.855180 24232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:38513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=45235
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:24.856026 24232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:24.856879 24232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:24.866345 24245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.866598 24249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.866859 24246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:24.867280 24232 server_base.cc:1034] running on GCE node
I20260809 02:23:24.867705 24232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:24.868391 24232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:24.875715 24232 hybrid_clock.cc:648] HybridClock initialized: now 1786242204875689 us; error 38 us; skew 500 ppm
Aug 09 02:23:24 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:24.878490 24232 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:23:24.879263 24232 webserver.cc:460] Webserver started at http://127.1.81.194:45235/ using document root <none> and password file <none>
I20260809 02:23:24.879769 24232 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:24.879870 24232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:24.883297 24232 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:23:24.885255 24257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:24.886339 24232 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:24.886444 24232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "ef31395791c341a483a9404b12d64c73"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-jlzn"
server_key: "767f14f2ac435581eca16955b8dc3e88"
server_key_iv: "8af01894a3d946714225bee3da3975ca"
server_key_version: "encryptionkey@0"
I20260809 02:23:24.886925 24232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:24.936345 24232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:24.938771 24232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:24.938932 24232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:24.939446 24232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:24.940433 24264 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:23:24.944144 24232 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:23:24.944199 24232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 02:23:24.944262 24232 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:23:24.945773 24232 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:23:24.945818 24232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 02:23:24.946048 24264 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Bootstrap starting.
I20260809 02:23:24.955221 24232 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:38513
I20260809 02:23:24.955338 24427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:38513 every 8 connection(s)
I20260809 02:23:24.956139 24232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:24.959499 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.957954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:53353)
0809 02:23:24.958450 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.958606 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":126,"threads_started":1}
W20260809 02:23:24.959946 24430 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:43585 (0 consecutive failures): Network error: Failed to ping master at 127.1.81.254:43585: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
I20260809 02:23:24.960568 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.960327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:57729)
0809 02:23:24.960444 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.960497 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 02:23:24.961210 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.960995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:44381)
0809 02:23:24.961105 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.961158 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 02:23:24.961367 24430 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:23:24.964469 24264 log.cc:824] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:24.965994 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 24232
I20260809 02:23:24.966357 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:36399
--local_ip_for_outbound_sockets=127.1.81.195
--tserver_master_addrs=127.1.81.254:43585
--webserver_port=38863
--webserver_interface=127.1.81.195
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:24.971299 24264 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:23:24.971693 24264 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Bootstrap complete.
I20260809 02:23:24.973133 24264 ts_tablet_manager.cc:1397] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Time spent bootstrapping tablet: real 0.027s user 0.018s sys 0.008s
I20260809 02:23:24.976555 24264 raft_consensus.cc:348] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.977087 24264 raft_consensus.cc:729] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef31395791c341a483a9404b12d64c73, State: Initialized, Role: FOLLOWER
I20260809 02:23:24.977587 24264 consensus_queue.cc:260] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:24.978546 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.978346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:42603)
0809 02:23:24.978446 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.978495 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 02:23:24.978565 24264 ts_tablet_manager.cc:1428] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:23:24.979297 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.979056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:49269)
0809 02:23:24.979185 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:24.979237 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:23:25.074725 24434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:25.074929 24434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:25.074983 24434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:25.078846 24434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:25.078894 24434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:25.078966 24434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:23:25.083832 24434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:36399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=38863
--tserver_master_addrs=127.1.81.254:43585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:25.084638 24434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:25.085451 24434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:25.093942 24445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:25.094020 24441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:25.093950 24443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:25.094264 24434 server_base.cc:1034] running on GCE node
I20260809 02:23:25.094611 24434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:25.095146 24434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:25.096302 24434 hybrid_clock.cc:648] HybridClock initialized: now 1786242205096285 us; error 28 us; skew 500 ppm
Aug 09 02:23:25 dist-test-slave-jlzn krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242205, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:25.098711 24434 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:23:25.099450 24434 webserver.cc:460] Webserver started at http://127.1.81.195:38863/ using document root <none> and password file <none>
I20260809 02:23:25.099982 24434 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:25.100051 24434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:25.103372 24434 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:23:25.105226 24454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:25.106271 24434 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:25.106374 24434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "8b045424110f41f09edcf4e0aee8e2d6"
format_stamp: "Formatted at 2026-08-09 02:23:23 on dist-test-slave-jlzn"
server_key: "12a3dda555630e823efc9a0c17e61445"
server_key_iv: "7efefb70d11ff07b06f8607a45d58441"
server_key_version: "encryptionkey@0"
I20260809 02:23:25.106814 24434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:25.130417 24434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:25.132826 24434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:25.132984 24434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:25.133504 24434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:25.134249 24434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:25.134297 24434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:25.134347 24434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:25.134377 24434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:25.142545 24434 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:36399
I20260809 02:23:25.142599 24619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:36399 every 8 connection(s)
I20260809 02:23:25.143433 24434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:25.143646 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 24434
I20260809 02:23:25.146950 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:25.145309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:53891)
0809 02:23:25.145716 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:25.145811 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":114,"threads_started":1}
W20260809 02:23:25.147418 24621 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:43585 (0 consecutive failures): Network error: Failed to ping master at 127.1.81.254:43585: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
I20260809 02:23:25.147956 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:25.147719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:37275)
0809 02:23:25.147853 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:25.147902 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:23:25.148492 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:25.148316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:50333)
0809 02:23:25.148405 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:25.148446 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 02:23:25.148633 24621 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:23:25.841698 24625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:25.841266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:59115)
0809 02:23:25.841497 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:25.841549 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":72,"threads_started":1}
I20260809 02:23:25.980253 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:25.979906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:37133)
0809 02:23:25.980119 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:25.980165 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":63,"threads_started":1}
I20260809 02:23:26.149427 24627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.149071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:44829)
0809 02:23:26.149285 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:26.149332 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":65,"threads_started":1}
I20260809 02:23:26.301913 24628 raft_consensus.cc:482] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:26.302107 24628 raft_consensus.cc:504] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:26.303162 24628 leader_election.cc:288] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399), 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445)
Aug 09 02:23:26 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
Aug 09 02:23:26 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.195@KRBTEST.COM
I20260809 02:23:26.315673 24632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.303543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:54651 (local address 127.1.81.193:37445)
0809 02:23:26.303987 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:26.303994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:26.304026 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:23:26.304424 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:26.304430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:26.304694 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:26.304887 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:26.306041 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:26.307076 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:26.308358 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:26.308811 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:26.308958 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:26.311458 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:26.311465 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:26.311480 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:26.311513 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:26.313057 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:26.313649 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:26.313655 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:26.313660 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:26.313820 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:26.314188 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:26.314192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:26.314193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:26.314620 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:26.314728 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:26.315270 (+ 542us) server_negotiation.cc:299] Negotiation successful
0809 02:23:26.315492 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":107,"threads_started":1}
I20260809 02:23:26.315706 24630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.303351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36399 (local address 127.1.81.194:53445)
0809 02:23:26.303655 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:26.303667 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:26.304070 (+ 403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:26.305697 (+ 1627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:26.305700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:26.305876 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:26.305974 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:26.305981 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:26.307415 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:26.307418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:26.308214 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:26.308225 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:26.308920 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:26.308924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:26.309128 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:26.309736 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:26.309748 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:26.311590 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:26.313656 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:26.313659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:26.313661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:26.313890 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:26.314220 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:26.314223 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:26.314225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:26.314308 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:26.314872 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:26.314874 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:26.314982 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 02:23:26.315152 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 02:23:26.315482 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":118,"spinlock_wait_cycles":14848,"thread_start_us":59,"threads_started":1}
I20260809 02:23:26.315721 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.303351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37445 (local address 127.1.81.194:54651)
0809 02:23:26.303531 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:26.303561 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:26.304078 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:26.304956 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:26.304963 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:26.305320 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:26.305834 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:26.305855 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:26.307230 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:26.307234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:26.308236 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:26.308250 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:26.308929 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:26.308933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:26.309126 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:26.309685 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:26.309700 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:26.311253 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:26.313181 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:26.313187 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:26.313199 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:26.313536 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:26.313911 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:26.313913 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:26.313915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:26.314093 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:26.314744 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:26.314750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:26.314986 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 02:23:26.315139 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 02:23:26.315554 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":205,"spinlock_wait_cycles":21376}
I20260809 02:23:26.315704 24631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.303533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:53445 (local address 127.1.81.195:36399)
0809 02:23:26.303993 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:26.304016 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:26.304055 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:23:26.305117 (+ 1062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:26.305127 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:26.305463 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:26.305695 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:26.306302 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:26.307277 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:26.308323 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:26.308804 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:26.308950 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:26.311768 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:26.311772 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:26.311782 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:26.311838 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:26.313559 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:26.313998 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:26.314003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:26.314008 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:26.314139 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:26.314390 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:26.314393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:26.314394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:26.314771 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:26.314891 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:26.315274 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 02:23:26.315513 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":90,"threads_started":1}
I20260809 02:23:26.316893 24157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb31bae28d54802b0f867c96ad4768c" candidate_uuid: "ef31395791c341a483a9404b12d64c73" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0534c788cf604a8f942f4e21f6869739" is_pre_election: true
I20260809 02:23:26.317193 24157 raft_consensus.cc:2454] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef31395791c341a483a9404b12d64c73 in term 1.
W20260809 02:23:26.318295 24261 leader_election.cc:341] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399): Not found: Tablet not found: 1cb31bae28d54802b0f867c96ad4768c
I20260809 02:23:26.318415 24261 leader_election.cc:302] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0534c788cf604a8f942f4e21f6869739, ef31395791c341a483a9404b12d64c73; no voters: 8b045424110f41f09edcf4e0aee8e2d6
I20260809 02:23:26.318655 24628 raft_consensus.cc:2781] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 02:23:26.318743 24628 raft_consensus.cc:482] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:26.318794 24628 raft_consensus.cc:3037] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:23:26.320813 24628 raft_consensus.cc:504] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:26.321125 24628 leader_election.cc:288] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 2 election: Requested vote from peers 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399), 0534c788cf604a8f942f4e21f6869739 (127.1.81.193:37445)
I20260809 02:23:26.321460 24157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cb31bae28d54802b0f867c96ad4768c" candidate_uuid: "ef31395791c341a483a9404b12d64c73" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0534c788cf604a8f942f4e21f6869739"
I20260809 02:23:26.321575 24157 raft_consensus.cc:3037] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 1 FOLLOWER]: Advancing to term 2
W20260809 02:23:26.321684 24261 leader_election.cc:341] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399): Not found: Tablet not found: 1cb31bae28d54802b0f867c96ad4768c
I20260809 02:23:26.323397 24157 raft_consensus.cc:2454] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef31395791c341a483a9404b12d64c73 in term 2.
I20260809 02:23:26.323680 24259 leader_election.cc:302] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0534c788cf604a8f942f4e21f6869739, ef31395791c341a483a9404b12d64c73; no voters: 8b045424110f41f09edcf4e0aee8e2d6
I20260809 02:23:26.323863 24628 raft_consensus.cc:2781] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:23:26.324049 24628 raft_consensus.cc:686] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [term 2 LEADER]: Becoming Leader. State: Replica: ef31395791c341a483a9404b12d64c73, State: Running, Role: LEADER
I20260809 02:23:26.324366 24628 consensus_queue.cc:237] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:26.324674 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.324472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:43881)
0809 02:23:26.324570 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:26.324618 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 02:23:26.738255 24157 raft_consensus.cc:1261] T 1cb31bae28d54802b0f867c96ad4768c P 0534c788cf604a8f942f4e21f6869739 [term 2 FOLLOWER]: Refusing update from remote peer ef31395791c341a483a9404b12d64c73: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260809 02:23:26.738909 24628 consensus_queue.cc:1035] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260809 02:23:26.740875 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.740503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:50663)
0809 02:23:26.740704 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:26.740765 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":58,"threads_started":1}
I20260809 02:23:26.743482 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.742762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:40673)
0809 02:23:26.743352 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:26.743408 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":519}
I20260809 02:23:26.743515 24638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:26.743255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:58453)
0809 02:23:26.743400 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:26.743450 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260809 02:23:26.743551 24261 consensus_peers.cc:487] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73 -> Peer 8b045424110f41f09edcf4e0aee8e2d6 (127.1.81.195:36399): Couldn't send request to peer 8b045424110f41f09edcf4e0aee8e2d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1cb31bae28d54802b0f867c96ad4768c. This is attempt 1: this message will repeat every 5th retry.
I20260809 02:23:27.150360 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.150001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:34559)
0809 02:23:27.150227 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:27.150277 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":70,"threads_started":1}
I20260809 02:23:27.276628 24651 ts_tablet_manager.cc:927] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Initiating tablet copy from peer ef31395791c341a483a9404b12d64c73 (127.1.81.194:38513)
I20260809 02:23:27.277257 24651 tablet_copy_client.cc:316] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: tablet copy: Beginning tablet copy session from remote peer at address 127.1.81.194:38513
Aug 09 02:23:27 dist-test-slave-jlzn krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242205, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.194@KRBTEST.COM
I20260809 02:23:27.286348 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.277724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:38513 (local address 127.1.81.195:41967)
0809 02:23:27.277837 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:27.277860 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:27.277985 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:27.278492 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:27.278499 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:27.278885 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:27.279001 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:27.279009 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:27.280027 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:27.280030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:27.280682 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:27.280692 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:27.281313 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:27.281317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:27.281437 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:27.281970 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:27.281983 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:27.283319 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:27.284954 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:27.284962 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:27.284967 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:27.285199 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:27.285421 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:27.285423 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:27.285424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:27.285494 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:27.285866 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:27.285870 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:27.285975 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 02:23:27.286084 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 02:23:27.286225 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:23:27.286392 24654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.277849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:41967 (local address 127.1.81.194:38513)
0809 02:23:27.278102 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:27.278108 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:27.278129 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:23:27.278174 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:27.278179 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:27.278346 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:27.278469 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:27.279125 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:27.279910 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:27.280798 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:27.281179 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:27.281293 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:27.283443 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:27.283452 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:27.283463 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:27.283486 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:27.284854 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:27.285280 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:27.285284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:27.285285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:27.285359 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:27.285552 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:27.285554 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:27.285555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:27.285787 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:27.285885 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:27.286150 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 02:23:27.286267 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":54,"threads_started":1}
I20260809 02:23:27.287312 24392 tablet_copy_service.cc:140] P ef31395791c341a483a9404b12d64c73: Received BeginTabletCopySession request for tablet 1cb31bae28d54802b0f867c96ad4768c from peer 8b045424110f41f09edcf4e0aee8e2d6 ({username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:41967)
I20260809 02:23:27.287459 24392 tablet_copy_service.cc:161] P ef31395791c341a483a9404b12d64c73: Beginning new tablet copy session on tablet 1cb31bae28d54802b0f867c96ad4768c from peer 8b045424110f41f09edcf4e0aee8e2d6 at {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:41967: session id = 8b045424110f41f09edcf4e0aee8e2d6-1cb31bae28d54802b0f867c96ad4768c
I20260809 02:23:27.288609 24392 tablet_copy_source_session.cc:205] T 1cb31bae28d54802b0f867c96ad4768c P ef31395791c341a483a9404b12d64c73: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 02:23:27.292447 24651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cb31bae28d54802b0f867c96ad4768c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:27.298552 24651 tablet_copy_client.cc:791] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: tablet copy: Starting download of 0 data blocks...
I20260809 02:23:27.298729 24651 tablet_copy_client.cc:655] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: tablet copy: Starting download of 1 WAL segments...
I20260809 02:23:27.300237 24651 tablet_copy_client.cc:531] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 02:23:27.301697 24651 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Bootstrap starting.
I20260809 02:23:27.306771 24651 log.cc:824] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:27.312628 24651 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:23:27.312909 24651 tablet_bootstrap.cc:492] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Bootstrap complete.
I20260809 02:23:27.313205 24651 ts_tablet_manager.cc:1397] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260809 02:23:27.315284 24651 raft_consensus.cc:348] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:27.315493 24651 raft_consensus.cc:729] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b045424110f41f09edcf4e0aee8e2d6, State: Initialized, Role: FOLLOWER
I20260809 02:23:27.315900 24651 consensus_queue.cc:260] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef31395791c341a483a9404b12d64c73" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 38513 } } peers { permanent_uuid: "8b045424110f41f09edcf4e0aee8e2d6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36399 } } peers { permanent_uuid: "0534c788cf604a8f942f4e21f6869739" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37445 } }
I20260809 02:23:27.316740 24651 ts_tablet_manager.cc:1428] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 02:23:27.316879 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.316643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:41649)
0809 02:23:27.316753 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:27.316808 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:23:27.317324 24392 tablet_copy_service.cc:342] P ef31395791c341a483a9404b12d64c73: Request end of tablet copy session 8b045424110f41f09edcf4e0aee8e2d6-1cb31bae28d54802b0f867c96ad4768c received from {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:41967
I20260809 02:23:27.317402 24392 tablet_copy_service.cc:433] P ef31395791c341a483a9404b12d64c73: ending tablet copy session 8b045424110f41f09edcf4e0aee8e2d6-1cb31bae28d54802b0f867c96ad4768c on tablet 1cb31bae28d54802b0f867c96ad4768c with peer 8b045424110f41f09edcf4e0aee8e2d6
I20260809 02:23:27.317473 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.317255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:50973)
0809 02:23:27.317360 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:27.317407 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 02:23:27.659902 24664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.659436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:49959)
0809 02:23:27.659723 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:27.659769 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":111,"threads_started":1}
I20260809 02:23:27.659924 24557 raft_consensus.cc:1203] T 1cb31bae28d54802b0f867c96ad4768c P 8b045424110f41f09edcf4e0aee8e2d6 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260809 02:23:27.660851 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.660608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:60201)
0809 02:23:27.660715 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:27.660769 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 02:23:27.744431 24665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.744128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:41479)
0809 02:23:27.744304 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:27.744353 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":56,"threads_started":1}
I20260809 02:23:28.661017 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:28.660619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:45325)
0809 02:23:28.660860 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:28.660916 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":68,"threads_started":1}
I20260809 02:23:28.661965 24667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:28.661518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:49271)
0809 02:23:28.661817 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:28.661874 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":85,"threads_started":1}
I20260809 02:23:28.745329 24670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:28.744990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:56779)
0809 02:23:28.745207 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:28.745255 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":74,"threads_started":1}
I20260809 02:23:29.662092 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:29.661703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:47669)
0809 02:23:29.661937 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:29.661991 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":74,"threads_started":1}
I20260809 02:23:29.662935 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:29.662571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:34405)
0809 02:23:29.662800 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:29.662851 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":69,"threads_started":1}
I20260809 02:23:29.746371 24675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:29.746025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:47577)
0809 02:23:29.746240 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:29.746291 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":65,"threads_started":1}
I20260809 02:23:30.663367 24677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:30.662963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:51643)
0809 02:23:30.663212 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:30.663266 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":73,"threads_started":1}
I20260809 02:23:30.664075 24677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:30.663851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:51451)
0809 02:23:30.663966 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:30.664012 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:23:30.664098 24680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:30.663714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:44911)
0809 02:23:30.663955 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:30.664010 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":83,"threads_started":1}
I20260809 02:23:30.747380 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:30.746949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:39923)
0809 02:23:30.747244 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:30.747294 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":73,"threads_started":1}
I20260809 02:23:31.665146 24684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:31.664754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:44443)
0809 02:23:31.664993 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:31.665046 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":84,"threads_started":1}
I20260809 02:23:31.665194 24685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:31.664754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:57661)
0809 02:23:31.665053 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:31.665102 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":84,"threads_started":1}
I20260809 02:23:31.748369 24686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:31.748003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:48285)
0809 02:23:31.748234 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:31.748284 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":81,"threads_started":1}
I20260809 02:23:32.666219 24687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:32.665808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:44293)
0809 02:23:32.666060 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:32.666112 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":71,"threads_started":1}
I20260809 02:23:32.666251 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:32.665811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:49745)
0809 02:23:32.666109 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:32.666160 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":72,"threads_started":1}
I20260809 02:23:32.749311 24691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:32.748940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:36683)
0809 02:23:32.749175 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:32.749226 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":85,"threads_started":1}
I20260809 02:23:33.667300 24692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:33.666902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:35513)
0809 02:23:33.667147 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:33.667199 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":86,"threads_started":1}
I20260809 02:23:33.667369 24695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:33.666902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:51845)
0809 02:23:33.667223 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:33.667274 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":88,"threads_started":1}
I20260809 02:23:33.750316 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:33.749930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:53881)
0809 02:23:33.750170 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:33.750222 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":71,"threads_started":1}
I20260809 02:23:34.668395 24700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:34.667981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:33723)
0809 02:23:34.668241 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:34.668294 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":71,"threads_started":1}
I20260809 02:23:34.668395 24702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:34.667986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:58837)
0809 02:23:34.668250 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:34.668303 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":96,"threads_started":1}
I20260809 02:23:34.751411 24703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:34.751031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:60511)
0809 02:23:34.751270 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:34.751319 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":68,"threads_started":1}
I20260809 02:23:35.669569 24704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:35.669170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:42449)
0809 02:23:35.669415 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:35.669467 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":70,"threads_started":1}
I20260809 02:23:35.669580 24705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:35.669195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:44117)
0809 02:23:35.669439 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:35.669490 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":76,"threads_started":1}
I20260809 02:23:35.752408 24708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:35.752028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:52611)
0809 02:23:35.752268 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:35.752320 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":68,"threads_started":1}
I20260809 02:23:36.670621 24710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:36.670205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:42115)
0809 02:23:36.670452 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:36.670515 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":70,"threads_started":1}
I20260809 02:23:36.670642 24711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:36.670250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:49365)
0809 02:23:36.670491 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:36.670551 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":66,"threads_started":1}
I20260809 02:23:36.753428 24712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:36.752999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:38367)
0809 02:23:36.753273 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:36.753328 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":102,"threads_started":1}
I20260809 02:23:37.671721 24718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:37.671337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:57465)
0809 02:23:37.671574 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:37.671625 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":74,"threads_started":1}
I20260809 02:23:37.671717 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:37.671285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:60721)
0809 02:23:37.671564 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:37.671616 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":102,"threads_started":1}
I20260809 02:23:37.754354 24719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:37.754004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:35397)
0809 02:23:37.754216 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:37.754269 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":65,"threads_started":1}
I20260809 02:23:38.672686 24720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:38.672312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:39533)
0809 02:23:38.672536 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:38.672588 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":74,"threads_started":1}
I20260809 02:23:38.672690 24721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:38.672331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:41197)
0809 02:23:38.672544 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:38.672594 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":65,"threads_started":1}
I20260809 02:23:38.755321 24722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:38.754921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:36987)
0809 02:23:38.755172 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:38.755230 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":67,"threads_started":1}
I20260809 02:23:39.673689 24726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:39.673319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.195:60869)
0809 02:23:39.673542 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:39.673594 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":75,"threads_started":1}
I20260809 02:23:39.673694 24723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:39.673297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.194:54521)
0809 02:23:39.673532 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:39.673583 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":74,"threads_started":1}
I20260809 02:23:39.756428 24727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:39.756078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43585 (local address 127.1.81.193:33915)
0809 02:23:39.756292 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:39.756341 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:43585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":76,"threads_started":1}
I20260809 02:23:40.149251 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 23971
I20260809 02:23:40.162449 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 24232
I20260809 02:23:40.171510 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 24434
2026-08-09T02:23:40Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19122 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:40 dist-test-slave-jlzn krb5kdc[24732](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:40 dist-test-slave-jlzn krb5kdc[24732](info): set up 2 sockets
Aug 09 02:23:40 dist-test-slave-jlzn krb5kdc[24732](info): commencing operation
krb5kdc: starting...
W20260809 02:23:41.292414 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:23:41 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:23:41.403390 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34593
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:34593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:41.508702 24754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:41.508922 24754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:41.508973 24754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:41.512812 24754 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:23:41.512857 24754 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:23:41.512877 24754 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:23:41.512894 24754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:41.512917 24754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:41.512949 24754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:41.512979 24754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:41.513000 24754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:41.517920 24754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:34593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:41.518808 24754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:41.519690 24754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:23:41.527616 24754 server_base.cc:1034] running on GCE node
W20260809 02:23:41.527592 24765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:41.527770 24764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:41.527585 24767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:41.528326 24754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:41.529239 24754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:41.530392 24754 hybrid_clock.cc:648] HybridClock initialized: now 1786242221530379 us; error 24 us; skew 500 ppm
Aug 09 02:23:41 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242221, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:41.532891 24754 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:23:41.533675 24754 webserver.cc:460] Webserver started at http://127.1.81.254:39723/ using document root <none> and password file <none>
I20260809 02:23:41.534138 24754 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:41.534207 24754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:41.534392 24754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:41.536249 24754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "15b42d5131c64021b8fdc1e7850d1959"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "74897e9063aa0e28ba702ae15f015a96"
server_key_iv: "9c6f352300648da0fabe9614f82b4a9e"
server_key_version: "encryptionkey@0"
I20260809 02:23:41.536754 24754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "15b42d5131c64021b8fdc1e7850d1959"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "74897e9063aa0e28ba702ae15f015a96"
server_key_iv: "9c6f352300648da0fabe9614f82b4a9e"
server_key_version: "encryptionkey@0"
I20260809 02:23:41.540042 24754 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:23:41.542132 24778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:41.543193 24754 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:41.543303 24754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "15b42d5131c64021b8fdc1e7850d1959"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "74897e9063aa0e28ba702ae15f015a96"
server_key_iv: "9c6f352300648da0fabe9614f82b4a9e"
server_key_version: "encryptionkey@0"
I20260809 02:23:41.543388 24754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:41.558044 24754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:41.560361 24754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:41.560515 24754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:41.566768 24754 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:34593
I20260809 02:23:41.567010 24861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:34593 every 8 connection(s)
I20260809 02:23:41.567662 24754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:41.568071 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 24754
I20260809 02:23:41.568194 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:23:41.568475 1351 external_mini_cluster.cc:1428] Setting key 5ea354ba49802402905a00cb752b70bc
I20260809 02:23:41.570329 24865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:41.575416 24865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Bootstrap starting.
Aug 09 02:23:41 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:41.577432 24865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:41.578336 24865 log.cc:824] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:41.580346 24865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: No bootstrap required, opened a new log
I20260809 02:23:41.581579 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:41.569657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47186 (local address 127.1.81.254:34593)
0809 02:23:41.570033 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:41.570052 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:41.570247 (+ 195us) server_negotiation.cc:407] Connection header received
0809 02:23:41.570938 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:41.570953 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:41.571254 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:41.571549 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:41.572368 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:41.573341 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:41.574188 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:41.574648 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:41.574787 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:41.577118 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:41.577123 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:41.577134 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:41.577169 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:41.578889 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:41.579363 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:41.579367 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:41.579372 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:41.579481 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:41.579760 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:41.579762 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:41.579763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:41.580154 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:41.580305 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:41.580606 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 02:23:41.580925 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":105,"threads_started":1}
I20260809 02:23:41.583704 24865 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:23:41.583933 24865 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:41.583992 24865 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15b42d5131c64021b8fdc1e7850d1959, State: Initialized, Role: FOLLOWER
I20260809 02:23:41.584379 24865 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:23:41.584504 24865 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:41.584564 24865 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:41.584652 24865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:41.585435 24865 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:23:41.585734 24865 leader_election.cc:302] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15b42d5131c64021b8fdc1e7850d1959; no voters:
I20260809 02:23:41.586007 24865 leader_election.cc:288] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:41.586127 24870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:41.586351 24870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 1 LEADER]: Becoming Leader. State: Replica: 15b42d5131c64021b8fdc1e7850d1959, State: Running, Role: LEADER
I20260809 02:23:41.586685 24870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:23:41.587105 24865 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:41.587673 24870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15b42d5131c64021b8fdc1e7850d1959. Latest consensus state: current_term: 1 leader_uuid: "15b42d5131c64021b8fdc1e7850d1959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } } }
I20260809 02:23:41.587793 24870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:41.588174 24878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:41.588267 24873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15b42d5131c64021b8fdc1e7850d1959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } } }
I20260809 02:23:41.588430 24873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:41.591133 24878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:41.596810 24878 catalog_manager.cc:1347] Generated new cluster ID: 7d2921f0ae294b52b2c1e94ddddb6df9
I20260809 02:23:41.596863 24878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:41.602802 24878 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:41.603571 24878 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:41.611291 24878 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Generated new TSK 0
I20260809 02:23:41.611869 24878 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:23:41.644551 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34593
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:41.773324 24900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:41.773538 24900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:41.773595 24900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:41.777434 24900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:41.777483 24900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:41.777554 24900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:23:41.782542 24900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:41.783411 24900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:41.784341 24900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:23:41.793817 24900 server_base.cc:1034] running on GCE node
W20260809 02:23:41.793862 24910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:41.793890 24909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:41.793862 24912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:41.794431 24900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:41.795009 24900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:41.796164 24900 hybrid_clock.cc:648] HybridClock initialized: now 1786242221796152 us; error 29 us; skew 500 ppm
Aug 09 02:23:41 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242221, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:41.798751 24900 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:23:41.799525 24900 webserver.cc:460] Webserver started at http://127.1.81.193:36135/ using document root <none> and password file <none>
I20260809 02:23:41.800064 24900 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:41.800133 24900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:41.800311 24900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:41.802130 24900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "36ae59f2d4cd4ed98ba1622d30abe175"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "e4325b1c8693c751ff40cac21651f63e"
server_key_iv: "3cd9d40c4d47c87998b905c3df5c8657"
server_key_version: "encryptionkey@0"
I20260809 02:23:41.802636 24900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "36ae59f2d4cd4ed98ba1622d30abe175"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "e4325b1c8693c751ff40cac21651f63e"
server_key_iv: "3cd9d40c4d47c87998b905c3df5c8657"
server_key_version: "encryptionkey@0"
I20260809 02:23:41.806001 24900 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:23:41.808169 24920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:41.809248 24900 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:41.809351 24900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "36ae59f2d4cd4ed98ba1622d30abe175"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "e4325b1c8693c751ff40cac21651f63e"
server_key_iv: "3cd9d40c4d47c87998b905c3df5c8657"
server_key_version: "encryptionkey@0"
I20260809 02:23:41.809439 24900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:41.833582 24900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:41.836432 24900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:41.836592 24900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:41.837100 24900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:41.837934 24900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:41.837992 24900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:41.838049 24900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:41.838080 24900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:41.847091 24900 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:40289
I20260809 02:23:41.847147 25082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:40289 every 8 connection(s)
I20260809 02:23:41.848029 24900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:41.850618 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 24900
I20260809 02:23:41.850754 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:41.851018 1351 external_mini_cluster.cc:1428] Setting key ce187136acb9ed7bd56ae0e83c7bdc14
Aug 09 02:23:41 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242221, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:41.860689 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:41.849675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:33027 (local address 127.1.81.254:34593)
0809 02:23:41.849804 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:41.849808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:41.850563 (+ 755us) server_negotiation.cc:407] Connection header received
0809 02:23:41.851912 (+ 1349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:41.851915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:41.851966 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:41.852040 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:41.853114 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:41.853638 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:41.854742 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:41.854975 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:41.855062 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:41.857442 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:41.857446 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:41.857448 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:41.857471 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:41.858743 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:41.859225 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:41.859228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:41.859229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:41.859309 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:41.859621 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:41.859625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:41.859627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:41.859829 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:41.859918 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:41.860391 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 02:23:41.860520 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:23:41.861394 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:41.849993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:33027)
0809 02:23:41.850427 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:41.850466 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:41.851711 (+ 1245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:41.852220 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:41.852227 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:41.852544 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:41.852976 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:41.852988 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:41.853763 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:41.853767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:41.854623 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:41.854633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:41.855109 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:41.855114 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:41.855279 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:41.855737 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:41.855756 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:41.857274 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:41.858856 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:41.858862 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:41.858875 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:41.859128 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:41.859394 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:41.859397 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:41.859399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:41.859530 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:41.859940 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:41.859947 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:41.860173 (+ 226us) client_negotiation.cc:769] Sending connection context
0809 02:23:41.860328 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 02:23:41.860622 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":116,"threads_started":1}
I20260809 02:23:41.862469 25083 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34593
I20260809 02:23:41.862697 25083 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:41.863155 25083 heartbeater.cc:511] Master 127.1.81.254:34593 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
I20260809 02:23:41.864643 24803 ts_manager.cc:194] Registered new tserver with Master: 36ae59f2d4cd4ed98ba1622d30abe175 (127.1.81.193:40289)
I20260809 02:23:41.865707 24803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:33027
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:23:41.878198 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34593
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:41.984700 25092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:41.984920 25092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:41.984977 25092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:41.988907 25092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:41.988957 25092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:41.989027 25092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:23:41.994125 25092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:41.994994 25092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:41.995910 25092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:42.004796 25102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:42.004796 25099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:42.004961 25092 server_base.cc:1034] running on GCE node
W20260809 02:23:42.004792 25100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:42.005388 25092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:42.005940 25092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:42.007079 25092 hybrid_clock.cc:648] HybridClock initialized: now 1786242222007064 us; error 28 us; skew 500 ppm
Aug 09 02:23:42 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242222, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:42.009582 25092 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:23:42.010355 25092 webserver.cc:460] Webserver started at http://127.1.81.194:37335/ using document root <none> and password file <none>
I20260809 02:23:42.010845 25092 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:42.010910 25092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:42.011083 25092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:42.012979 25092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "8f46619b6d13485f86be00cde238823c"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "94795b619fcadd478e5738726d29b1cc"
server_key_iv: "a6378edae8afe25ddd8231f4035eef36"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.013484 25092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "8f46619b6d13485f86be00cde238823c"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "94795b619fcadd478e5738726d29b1cc"
server_key_iv: "a6378edae8afe25ddd8231f4035eef36"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.016812 25092 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 02:23:42.018922 25109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:42.020048 25092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:23:42.020152 25092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "8f46619b6d13485f86be00cde238823c"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "94795b619fcadd478e5738726d29b1cc"
server_key_iv: "a6378edae8afe25ddd8231f4035eef36"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.020241 25092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:42.048105 25092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:42.050822 25092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:42.050980 25092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:42.051477 25092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:42.052249 25092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:42.052299 25092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:42.052349 25092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:42.052377 25092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:42.060493 25092 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:40401
I20260809 02:23:42.060523 25286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:40401 every 8 connection(s)
I20260809 02:23:42.061240 25092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:42.063490 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 25092
I20260809 02:23:42.063613 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:42.063961 1351 external_mini_cluster.cc:1428] Setting key be53714bb5e0f76da47d125847039be6
Aug 09 02:23:42 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242222, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:42.074733 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.062756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:36373 (local address 127.1.81.254:34593)
0809 02:23:42.062869 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.062872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.063698 (+ 826us) server_negotiation.cc:407] Connection header received
0809 02:23:42.065089 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.065092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.065141 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.065225 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:42.066547 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.067057 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.068573 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.068809 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.068891 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.071407 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:42.071410 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:42.071412 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:42.071437 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:42.072762 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:42.073339 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:42.073342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:42.073343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:42.073412 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:42.073752 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:42.073754 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:42.073755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:42.073907 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:42.073976 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.074525 (+ 549us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.074615 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
I20260809 02:23:42.075642 25292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.063051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:36373)
0809 02:23:42.063515 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:42.063568 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:42.064899 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:42.065387 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:42.065395 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:42.065845 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:42.066405 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.066424 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.067198 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.067201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.068449 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.068462 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.068953 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.068957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.069120 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.069590 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:42.069607 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:42.071247 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:42.072882 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:42.072888 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:42.072902 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:42.073252 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:42.073490 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:42.073493 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:42.073495 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:42.073671 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:42.074004 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:42.074010 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:42.074302 (+ 292us) client_negotiation.cc:769] Sending connection context
0809 02:23:42.074507 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 02:23:42.074815 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":110,"threads_started":1}
I20260809 02:23:42.076623 25289 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34593
I20260809 02:23:42.076846 25289 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:42.077309 25289 heartbeater.cc:511] Master 127.1.81.254:34593 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
I20260809 02:23:42.078393 24803 ts_manager.cc:194] Registered new tserver with Master: 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401)
I20260809 02:23:42.079111 24803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:36373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:23:42.090534 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34593
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:42.195931 25297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:42.196149 25297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:42.196203 25297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:42.200063 25297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:42.200111 25297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:42.200184 25297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:23:42.205075 25297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:23:42.205914 25297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:42.206782 25297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:42.215512 25304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:42.215525 25307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:42.215571 25305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:42.215752 25297 server_base.cc:1034] running on GCE node
I20260809 02:23:42.216125 25297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:42.216681 25297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:42.217835 25297 hybrid_clock.cc:648] HybridClock initialized: now 1786242222217818 us; error 29 us; skew 500 ppm
Aug 09 02:23:42 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242222, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:42.220316 25297 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:23:42.221028 25297 webserver.cc:460] Webserver started at http://127.1.81.195:34449/ using document root <none> and password file <none>
I20260809 02:23:42.221480 25297 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:42.221535 25297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:42.221695 25297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:42.223485 25297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "6b9700297ebf4930b1b2865ab87bed22"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "4cb47bc304ccdb3c0ae0c6de31e2dfce"
server_key_iv: "825c8724c85ac45b07a46bb07502b150"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.224057 25297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "6b9700297ebf4930b1b2865ab87bed22"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "4cb47bc304ccdb3c0ae0c6de31e2dfce"
server_key_iv: "825c8724c85ac45b07a46bb07502b150"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.227324 25297 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260809 02:23:42.229507 25317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:42.230559 25297 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:42.230664 25297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "6b9700297ebf4930b1b2865ab87bed22"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "4cb47bc304ccdb3c0ae0c6de31e2dfce"
server_key_iv: "825c8724c85ac45b07a46bb07502b150"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.230772 25297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:42.241849 25297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:42.244551 25297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:42.244709 25297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:42.245219 25297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:42.245952 25297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:42.245998 25297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:42.246037 25297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:42.246066 25297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:42.254019 25297 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:37289
I20260809 02:23:42.254101 25491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:37289 every 8 connection(s)
I20260809 02:23:42.254753 25297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:42.255460 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 25297
I20260809 02:23:42.255573 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:42.255867 1351 external_mini_cluster.cc:1428] Setting key 669e51e92ee6f11620caecf41bc8f5e4
Aug 09 02:23:42 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242222, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:23:42.266286 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.256371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:47731 (local address 127.1.81.254:34593)
0809 02:23:42.256504 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.256509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.257385 (+ 876us) server_negotiation.cc:407] Connection header received
0809 02:23:42.258687 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.258690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.258736 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.258799 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:42.259772 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.260332 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.261361 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.261562 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.261629 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.263661 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:42.263665 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:42.263666 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:42.263692 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:42.264783 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:42.265193 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:42.265196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:42.265197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:42.265264 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:42.265502 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:42.265504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:42.265505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:42.265651 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:42.265718 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.266079 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.266172 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:23:42.266970 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.256751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:47731)
0809 02:23:42.257230 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:42.257281 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:42.258511 (+ 1230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:42.258934 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:42.258940 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:42.259262 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:42.259667 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.259680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.260430 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.260433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.261271 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.261280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.261661 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.261664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.261789 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.262205 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:42.262220 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:42.263518 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:42.264878 (+ 1360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:42.264883 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:42.264892 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:42.265122 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:42.265323 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:42.265325 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:42.265327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:42.265442 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:42.265721 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:42.265725 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:42.265914 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 02:23:42.266049 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 02:23:42.266259 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":103,"threads_started":1}
I20260809 02:23:42.267897 25492 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34593
I20260809 02:23:42.268112 25492 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:42.268610 25492 heartbeater.cc:511] Master 127.1.81.254:34593 requested a full tablet report, sending...
I20260809 02:23:42.269546 24803 ts_manager.cc:194] Registered new tserver with Master: 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
I20260809 02:23:42.270064 24803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:47731
I20260809 02:23:42.280838 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:42.288523 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.282555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.1.81.254:34593)
0809 02:23:42.282699 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.282703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.282816 (+ 113us) server_negotiation.cc:407] Connection header received
0809 02:23:42.282899 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.282901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.282934 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.282995 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:42.283559 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.284068 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.284818 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.285007 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.285069 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.286135 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:42.286138 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:42.286139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:42.286153 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:42.287161 (+ 1008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:42.287528 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:42.287530 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:42.287531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:42.287599 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:42.287796 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:42.287819 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:42.287821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:42.288015 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:42.288130 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.288309 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.288391 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:23:42.290890 24803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:42.293723 24803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:42.306938 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.301157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:40289 (local address 127.0.0.1:42974)
0809 02:23:42.302192 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:42.302205 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:42.302277 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:42.302772 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:42.302778 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:42.302803 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:42.302920 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.302927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.304118 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.304121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.305398 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.305409 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.306435 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.306439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.306546 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.306583 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:23:42.306689 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:23:42.306807 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
I20260809 02:23:42.306950 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.301542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42974 (local address 127.1.81.193:40289)
0809 02:23:42.301948 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.301959 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.302365 (+ 406us) server_negotiation.cc:407] Connection header received
0809 02:23:42.302440 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.302445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.302617 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.302774 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:42.303042 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.303995 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.305527 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.306334 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.306421 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.306560 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.306731 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.306819 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":134,"threads_started":1}
I20260809 02:23:42.307235 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.301807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40401 (local address 127.0.0.1:60028)
0809 02:23:42.303021 (+ 1214us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:42.303033 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:42.303132 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:42.303488 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:42.303491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:42.303509 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:42.303596 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.303602 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.304813 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.304817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.305784 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.305792 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.306842 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.306846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.306942 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.306966 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:23:42.307040 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:23:42.307114 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1153,"thread_start_us":82,"threads_started":1}
I20260809 02:23:42.307677 25512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.302216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60028 (local address 127.1.81.194:40401)
0809 02:23:42.302646 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.302657 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.303122 (+ 465us) server_negotiation.cc:407] Connection header received
0809 02:23:42.303236 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.303239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.303371 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.303477 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:42.303680 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.304663 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.305894 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.306535 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.306631 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.306772 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.307410 (+ 638us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.307506 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":100,"threads_started":1}
I20260809 02:23:42.308745 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.301283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:37289 (local address 127.0.0.1:48786)
0809 02:23:42.302047 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:42.302093 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:42.302215 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:42.302820 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:42.302822 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:42.302836 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:42.302925 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.302931 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.305041 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.305044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.306154 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.306166 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.308357 (+ 2191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.308360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.308458 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.308481 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:23:42.308554 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 02:23:42.308621 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":23,"thread_start_us":89,"threads_started":1}
I20260809 02:23:42.309250 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.301478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48786 (local address 127.1.81.195:37289)
0809 02:23:42.301925 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.301937 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.302353 (+ 416us) server_negotiation.cc:407] Connection header received
0809 02:23:42.302425 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.302430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.302703 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.302830 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:42.304127 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.304907 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.306290 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.308052 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.308162 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.308287 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.309016 (+ 729us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.309106 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":140,"threads_started":1}
I20260809 02:23:42.309865 24984 tablet_service.cc:1467] Processing CreateTablet for tablet 0593902e98e549caa529002062c838f6 (DEFAULT_TABLE table=test-table [id=6afabca1780d4cee8bb3533d9382e758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:42.310333 25179 tablet_service.cc:1467] Processing CreateTablet for tablet 0593902e98e549caa529002062c838f6 (DEFAULT_TABLE table=test-table [id=6afabca1780d4cee8bb3533d9382e758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:42.310982 24984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0593902e98e549caa529002062c838f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:42.311214 25179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0593902e98e549caa529002062c838f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:42.311754 25385 tablet_service.cc:1467] Processing CreateTablet for tablet 0593902e98e549caa529002062c838f6 (DEFAULT_TABLE table=test-table [id=6afabca1780d4cee8bb3533d9382e758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:42.312760 25385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0593902e98e549caa529002062c838f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:42.317170 25514 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Bootstrap starting.
I20260809 02:23:42.318368 25515 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Bootstrap starting.
I20260809 02:23:42.319036 25516 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Bootstrap starting.
I20260809 02:23:42.319975 25514 tablet_bootstrap.cc:654] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:42.320466 25515 tablet_bootstrap.cc:654] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:42.320886 25514 log.cc:824] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:42.321259 25516 tablet_bootstrap.cc:654] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:42.321595 25515 log.cc:824] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:42.322041 25516 log.cc:824] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:42.322986 25514 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: No bootstrap required, opened a new log
I20260809 02:23:42.323192 25514 ts_tablet_manager.cc:1397] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:23:42.323596 25515 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: No bootstrap required, opened a new log
I20260809 02:23:42.323650 25516 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: No bootstrap required, opened a new log
I20260809 02:23:42.323792 25515 ts_tablet_manager.cc:1397] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:23:42.323959 25516 ts_tablet_manager.cc:1397] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:23:42.326992 25516 raft_consensus.cc:348] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.326982 25514 raft_consensus.cc:348] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.327198 25516 raft_consensus.cc:374] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:42.327247 25516 raft_consensus.cc:729] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b9700297ebf4930b1b2865ab87bed22, State: Initialized, Role: FOLLOWER
I20260809 02:23:42.327260 25514 raft_consensus.cc:374] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:42.327315 25514 raft_consensus.cc:729] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f46619b6d13485f86be00cde238823c, State: Initialized, Role: FOLLOWER
I20260809 02:23:42.327368 25515 raft_consensus.cc:348] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.327591 25515 raft_consensus.cc:374] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:42.327639 25515 raft_consensus.cc:729] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36ae59f2d4cd4ed98ba1622d30abe175, State: Initialized, Role: FOLLOWER
I20260809 02:23:42.327636 25516 consensus_queue.cc:260] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.327792 25514 consensus_queue.cc:260] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.328032 25515 consensus_queue.cc:260] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.328372 25492 heartbeater.cc:503] Master 127.1.81.254:34593 was elected leader, sending a full tablet report...
I20260809 02:23:42.328595 25516 ts_tablet_manager.cc:1428] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:23:42.328773 25514 ts_tablet_manager.cc:1428] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260809 02:23:42.328801 25515 ts_tablet_manager.cc:1428] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260809 02:23:42.329108 25289 heartbeater.cc:503] Master 127.1.81.254:34593 was elected leader, sending a full tablet report...
I20260809 02:23:42.329990 25083 heartbeater.cc:503] Master 127.1.81.254:34593 was elected leader, sending a full tablet report...
W20260809 02:23:42.349217 25085 tablet.cc:2369] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:23:42.505803 25494 tablet.cc:2369] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:42.517290 25521 raft_consensus.cc:482] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:42.517464 25521 raft_consensus.cc:504] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.518618 25521 leader_election.cc:288] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36ae59f2d4cd4ed98ba1622d30abe175 (127.1.81.193:40289), 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401)
I20260809 02:23:42.523557 25512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.518960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:36715 (local address 127.1.81.194:40401)
0809 02:23:42.519116 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.519120 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.519176 (+ 56us) server_negotiation.cc:407] Connection header received
0809 02:23:42.519344 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.519347 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.519405 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.519482 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:42.519851 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.520640 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.522333 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.522934 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.523051 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.523104 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.523349 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.523424 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:23:42.523557 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.518849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:33135 (local address 127.1.81.193:40289)
0809 02:23:42.518976 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.518981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.519317 (+ 336us) server_negotiation.cc:407] Connection header received
0809 02:23:42.519397 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.519400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.519447 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.519516 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:42.519851 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.520640 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.522333 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.522934 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.523052 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.523104 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.523349 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.523424 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:23:42.523628 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.518796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40401 (local address 127.1.81.195:36715)
0809 02:23:42.519104 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:42.519120 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:42.519230 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:42.519512 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:42.519515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:42.519533 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:42.519727 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.519735 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.520767 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.520771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.522209 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.522222 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.523043 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.523047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.523214 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.523251 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:23:42.523330 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 02:23:42.523450 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":209,"spinlock_wait_cycles":9216}
I20260809 02:23:42.523643 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.518796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:40289 (local address 127.1.81.195:33135)
0809 02:23:42.519226 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:42.519238 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:42.519323 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:42.519524 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:42.519526 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:42.519581 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:42.519736 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.519743 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.520767 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.520771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.522209 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:42.522222 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.523043 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.523047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:42.523193 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.523256 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 02:23:42.523330 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:23:42.523446 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":186,"spinlock_wait_cycles":30336,"thread_start_us":139,"threads_started":1}
I20260809 02:23:42.524277 25209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0593902e98e549caa529002062c838f6" candidate_uuid: "6b9700297ebf4930b1b2865ab87bed22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f46619b6d13485f86be00cde238823c" is_pre_election: true
I20260809 02:23:42.524474 25008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0593902e98e549caa529002062c838f6" candidate_uuid: "6b9700297ebf4930b1b2865ab87bed22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" is_pre_election: true
I20260809 02:23:42.524595 25209 raft_consensus.cc:2454] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9700297ebf4930b1b2865ab87bed22 in term 0.
I20260809 02:23:42.524762 25008 raft_consensus.cc:2454] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9700297ebf4930b1b2865ab87bed22 in term 0.
I20260809 02:23:42.525060 25320 leader_election.cc:302] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9700297ebf4930b1b2865ab87bed22, 8f46619b6d13485f86be00cde238823c; no voters:
I20260809 02:23:42.525329 25521 raft_consensus.cc:2781] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:42.525401 25521 raft_consensus.cc:482] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:42.525429 25521 raft_consensus.cc:3037] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:42.526396 25521 raft_consensus.cc:504] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.526696 25521 leader_election.cc:288] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [CANDIDATE]: Term 1 election: Requested vote from peers 36ae59f2d4cd4ed98ba1622d30abe175 (127.1.81.193:40289), 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401)
I20260809 02:23:42.527040 25209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0593902e98e549caa529002062c838f6" candidate_uuid: "6b9700297ebf4930b1b2865ab87bed22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f46619b6d13485f86be00cde238823c"
I20260809 02:23:42.527030 25008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0593902e98e549caa529002062c838f6" candidate_uuid: "6b9700297ebf4930b1b2865ab87bed22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36ae59f2d4cd4ed98ba1622d30abe175"
I20260809 02:23:42.527166 25209 raft_consensus.cc:3037] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:42.527154 25008 raft_consensus.cc:3037] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:42.528440 25008 raft_consensus.cc:2454] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9700297ebf4930b1b2865ab87bed22 in term 1.
I20260809 02:23:42.528440 25209 raft_consensus.cc:2454] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9700297ebf4930b1b2865ab87bed22 in term 1.
I20260809 02:23:42.528751 25319 leader_election.cc:302] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 36ae59f2d4cd4ed98ba1622d30abe175, 6b9700297ebf4930b1b2865ab87bed22, 8f46619b6d13485f86be00cde238823c; no voters:
I20260809 02:23:42.528929 25521 raft_consensus.cc:2781] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:42.529124 25521 raft_consensus.cc:686] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 1 LEADER]: Becoming Leader. State: Replica: 6b9700297ebf4930b1b2865ab87bed22, State: Running, Role: LEADER
I20260809 02:23:42.529425 25521 consensus_queue.cc:237] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:23:42.532512 24800 catalog_manager.cc:5495] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195). New cstate: current_term: 1 leader_uuid: "6b9700297ebf4930b1b2865ab87bed22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } health_report { overall_health: UNKNOWN } } }
W20260809 02:23:42.562289 25291 tablet.cc:2369] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:42.596632 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.593073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48796 (local address 127.1.81.195:37289)
0809 02:23:42.593205 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.593210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.593224 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:23:42.593338 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.593341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.593393 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.593479 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:42.593721 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.594222 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.595080 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:42.595408 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:42.595523 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:42.595896 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:42.596296 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:42.596385 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.596466 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.596515 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:23:42.601933 25209 raft_consensus.cc:1261] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 1 FOLLOWER]: Refusing update from remote peer 6b9700297ebf4930b1b2865ab87bed22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:42.601960 25008 raft_consensus.cc:1261] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Refusing update from remote peer 6b9700297ebf4930b1b2865ab87bed22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:42.602547 25529 consensus_queue.cc:1035] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:42.602718 25521 consensus_queue.cc:1035] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:42.608922 25532 mvcc.cc:205] Tried to move back new op lower bound from 7316448143771156480 to 7316448143482720256. Current Snapshot: MvccSnapshot[applied={T|T < 7316448143771156480}]
I20260809 02:23:42.609927 25533 mvcc.cc:205] Tried to move back new op lower bound from 7316448143771156480 to 7316448143482720256. Current Snapshot: MvccSnapshot[applied={T|T < 7316448143771156480}]
I20260809 02:23:42.611089 25534 mvcc.cc:205] Tried to move back new op lower bound from 7316448143771156480 to 7316448143482720256. Current Snapshot: MvccSnapshot[applied={T|T < 7316448143771156480}]
I20260809 02:23:42.618075 24800 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:42.618207 24800 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:42.620390 24800 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Sending DeleteTablet for 3 replicas of tablet 0593902e98e549caa529002062c838f6
I20260809 02:23:42.621006 24984 tablet_service.cc:1514] Processing DeleteTablet for tablet 0593902e98e549caa529002062c838f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:42 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:42974
I20260809 02:23:42.621189 25179 tablet_service.cc:1514] Processing DeleteTablet for tablet 0593902e98e549caa529002062c838f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:42 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:60028
I20260809 02:23:42.621279 25385 tablet_service.cc:1514] Processing DeleteTablet for tablet 0593902e98e549caa529002062c838f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:42 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:48786
I20260809 02:23:42.621502 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 24900
I20260809 02:23:42.621668 25546 tablet_replica.cc:330] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: stopping tablet replica
I20260809 02:23:42.621815 25547 tablet_replica.cc:330] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: stopping tablet replica
I20260809 02:23:42.622104 25547 raft_consensus.cc:2229] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:23:42.622107 25546 raft_consensus.cc:2229] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:42.622514 25546 raft_consensus.cc:2258] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:42.622519 25547 raft_consensus.cc:2258] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:42.627125 25546 ts_tablet_manager.cc:1905] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:42.627339 25547 ts_tablet_manager.cc:1905] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:42.630502 25546 ts_tablet_manager.cc:1918] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:42.630743 25547 ts_tablet_manager.cc:1918] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:42.630873 25547 log.cc:1196] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/0593902e98e549caa529002062c838f6
I20260809 02:23:42.631276 25547 ts_tablet_manager.cc:1939] T 0593902e98e549caa529002062c838f6 P 6b9700297ebf4930b1b2865ab87bed22: Deleting consensus metadata
I20260809 02:23:42.631410 25546 log.cc:1196] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/0593902e98e549caa529002062c838f6
I20260809 02:23:42.631788 25546 ts_tablet_manager.cc:1939] T 0593902e98e549caa529002062c838f6 P 8f46619b6d13485f86be00cde238823c: Deleting consensus metadata
I20260809 02:23:42.632346 24780 catalog_manager.cc:4841] TS 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289): tablet 0593902e98e549caa529002062c838f6 (table test-table [id=6afabca1780d4cee8bb3533d9382e758]) successfully deleted
I20260809 02:23:42.633252 24780 catalog_manager.cc:4841] TS 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401): tablet 0593902e98e549caa529002062c838f6 (table test-table [id=6afabca1780d4cee8bb3533d9382e758]) successfully deleted
I20260809 02:23:42.640633 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 25092
W20260809 02:23:42.640622 24779 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:40289 (error 108)
I20260809 02:23:42.659472 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.659174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:40289 (local address 127.0.0.1:42990)
0809 02:23:42.659304 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:42.659381 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:40289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:23:42.659652 24779 catalog_manager.cc:4584] TS 36ae59f2d4cd4ed98ba1622d30abe175 (127.1.81.193:40289): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0593902e98e549caa529002062c838f6: Network error: Client connection negotiation failed: client connection to 127.1.81.193:40289: connect: Connection refused (error 111)
I20260809 02:23:42.664397 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 25297
I20260809 02:23:42.674381 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 24754
I20260809 02:24:02.684861 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34593
--webserver_interface=127.1.81.254
--webserver_port=39723
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:34593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:02.792495 25549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:02.792717 25549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:02.792758 25549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:02.796633 25549 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:24:02.796674 25549 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:24:02.796689 25549 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:24:02.796715 25549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:02.796744 25549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:02.796773 25549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:02.796804 25549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:02.796833 25549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:02.801787 25549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:34593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=39723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:02.802637 25549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:02.803506 25549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:02.815972 25558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:02.815980 25556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:02.816001 25562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:02.816179 25549 server_base.cc:1034] running on GCE node
I20260809 02:24:02.816946 25549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:02.817991 25549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:02.819154 25549 hybrid_clock.cc:648] HybridClock initialized: now 1786242242819132 us; error 31 us; skew 500 ppm
Aug 09 02:24:02 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242242, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:02.821863 25549 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:24:02.822677 25549 webserver.cc:460] Webserver started at http://127.1.81.254:39723/ using document root <none> and password file <none>
I20260809 02:24:02.823215 25549 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:02.823299 25549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:02.826925 25549 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:02.828922 25573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:02.830024 25549 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 02:24:02.830168 25549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "15b42d5131c64021b8fdc1e7850d1959"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "74897e9063aa0e28ba702ae15f015a96"
server_key_iv: "9c6f352300648da0fabe9614f82b4a9e"
server_key_version: "encryptionkey@0"
I20260809 02:24:02.830703 25549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:02.852713 25549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:02.855631 25549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:02.855821 25549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:02.862494 25549 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:34593
I20260809 02:24:02.862744 25662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:34593 every 8 connection(s)
I20260809 02:24:02.863547 25549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:02.869059 25663 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:24:02.871117 25663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Bootstrap starting.
I20260809 02:24:02.871418 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 25549
I20260809 02:24:02.871932 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:40289
--local_ip_for_outbound_sockets=127.1.81.193
--tserver_master_addrs=127.1.81.254:34593
--webserver_port=36135
--webserver_interface=127.1.81.193
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:24:02.890882 25663 log.cc:824] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:02.899283 25663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:24:02.899650 25663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Bootstrap complete.
I20260809 02:24:02.903702 25663 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:24:02.904268 25663 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15b42d5131c64021b8fdc1e7850d1959, State: Initialized, Role: FOLLOWER
I20260809 02:24:02.904844 25663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:24:02.905014 25663 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:02.905126 25663 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:02.905246 25663 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:24:02.907184 25663 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:24:02.907493 25663 leader_election.cc:302] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15b42d5131c64021b8fdc1e7850d1959; no voters:
I20260809 02:24:02.907758 25663 leader_election.cc:288] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:24:02.907899 25668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:24:02.908157 25668 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 2 LEADER]: Becoming Leader. State: Replica: 15b42d5131c64021b8fdc1e7850d1959, State: Running, Role: LEADER
I20260809 02:24:02.908514 25668 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:24:02.908901 25663 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:02.909451 25668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15b42d5131c64021b8fdc1e7850d1959. Latest consensus state: current_term: 2 leader_uuid: "15b42d5131c64021b8fdc1e7850d1959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } } }
I20260809 02:24:02.909667 25668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:02.909842 25670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "15b42d5131c64021b8fdc1e7850d1959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } } }
I20260809 02:24:02.909950 25670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:02.910207 25680 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:02.915045 25680 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:02.915940 25680 catalog_manager.cc:1259] Loaded cluster ID: 7d2921f0ae294b52b2c1e94ddddb6df9
I20260809 02:24:02.916004 25680 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:02.918397 25680 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:02.919109 25680 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Loaded TSK: 0
I20260809 02:24:02.935607 25680 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Generated new TSK 1
I20260809 02:24:02.935859 25680 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:24:02.991560 25665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:02.991778 25665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:02.991851 25665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:02.995715 25665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:02.995765 25665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:02.995857 25665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:24:03.001170 25665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:40289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=36135
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:03.002018 25665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:03.002900 25665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:03.012856 25700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:03.012888 25704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:03.012851 25701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:03.016767 25665 server_base.cc:1034] running on GCE node
I20260809 02:24:03.017135 25665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:03.017706 25665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:03.018895 25665 hybrid_clock.cc:648] HybridClock initialized: now 1786242243018863 us; error 49 us; skew 500 ppm
Aug 09 02:24:03 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:03.021750 25665 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:24:03.022784 25665 webserver.cc:460] Webserver started at http://127.1.81.193:36135/ using document root <none> and password file <none>
I20260809 02:24:03.023478 25665 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:03.023590 25665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:03.028144 25665 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:24:03.030468 25712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:03.031836 25665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:24:03.031953 25665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "36ae59f2d4cd4ed98ba1622d30abe175"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "e4325b1c8693c751ff40cac21651f63e"
server_key_iv: "3cd9d40c4d47c87998b905c3df5c8657"
server_key_version: "encryptionkey@0"
I20260809 02:24:03.032585 25665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:03.062323 25665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:03.064803 25665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:03.064941 25665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:03.065461 25665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:03.066412 25722 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:24:03.070189 25665 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:24:03.070245 25665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 02:24:03.070308 25665 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:24:03.071900 25665 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:24:03.071946 25665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:03.072187 25722 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Bootstrap starting.
I20260809 02:24:03.081247 25665 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:40289
I20260809 02:24:03.081341 25869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:40289 every 8 connection(s)
I20260809 02:24:03.082154 25665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:24:03.090870 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 25665
I20260809 02:24:03.091349 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:40401
--local_ip_for_outbound_sockets=127.1.81.194
--tserver_master_addrs=127.1.81.254:34593
--webserver_port=37335
--webserver_interface=127.1.81.194
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:24:03.091588 25722 log.cc:824] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:24:03 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:03.099224 25722 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:24:03.099620 25722 tablet_bootstrap.cc:492] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Bootstrap complete.
I20260809 02:24:03.099963 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.083963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:38655 (local address 127.1.81.254:34593)
0809 02:24:03.084348 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.084368 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.084702 (+ 334us) server_negotiation.cc:407] Connection header received
0809 02:24:03.085982 (+ 1280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.085992 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.086266 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.086523 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:03.087991 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.088921 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.090635 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.091315 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.091486 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.094386 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:03.094392 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:03.094407 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:03.094441 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:03.096406 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.097043 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.097049 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.097054 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.097221 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.097626 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.097629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.097631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.098049 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:03.098188 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.098834 (+ 646us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.099122 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":119,"threads_started":1}
I20260809 02:24:03.099984 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.083926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:38655)
0809 02:24:03.084512 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.084580 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:03.085629 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:03.086684 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:03.086693 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:03.087154 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:03.087827 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.087857 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.089083 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.089087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.090518 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.090530 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.091664 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.091669 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.091874 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.092418 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:03.092435 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:03.094178 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:03.096534 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:03.096541 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:03.096556 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:03.096907 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:03.097321 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:03.097324 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:03.097326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:03.097511 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:03.098179 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:03.098186 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:03.098477 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 02:24:03.098675 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 02:24:03.099003 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":130,"threads_started":1}
I20260809 02:24:03.101050 25722 ts_tablet_manager.cc:1397] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Time spent bootstrapping tablet: real 0.029s user 0.023s sys 0.004s
I20260809 02:24:03.102406 25870 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34593
I20260809 02:24:03.102628 25870 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:03.103130 25870 heartbeater.cc:511] Master 127.1.81.254:34593 requested a full tablet report, sending...
I20260809 02:24:03.103467 25722 raft_consensus.cc:348] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:24:03.103991 25722 raft_consensus.cc:729] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36ae59f2d4cd4ed98ba1622d30abe175, State: Initialized, Role: FOLLOWER
I20260809 02:24:03.104423 25722 consensus_queue.cc:260] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } }
I20260809 02:24:03.105372 25722 ts_tablet_manager.cc:1428] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 02:24:03.105747 25611 ts_manager.cc:194] Registered new tserver with Master: 36ae59f2d4cd4ed98ba1622d30abe175 (127.1.81.193:40289)
I20260809 02:24:03.109561 25611 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:38655
I20260809 02:24:03.112306 25870 heartbeater.cc:503] Master 127.1.81.254:34593 was elected leader, sending a full tablet report...
Aug 09 02:24:03 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242242, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.193@KRBTEST.COM
I20260809 02:24:03.117828 25884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.108461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:40289 (local address 127.0.0.1:55118)
0809 02:24:03.108961 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.109009 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:03.109129 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:03.109600 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:03.109606 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:03.110142 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:03.110293 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.110302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.111430 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.111434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.112097 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.112107 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.112805 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.112808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.112888 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.113345 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:03.113357 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:03.114586 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:03.116263 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:03.116272 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:03.116278 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:03.116486 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:03.116764 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:03.116767 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:03.116769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:03.116846 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:03.117249 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:03.117254 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:03.117364 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 02:24:03.117478 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 02:24:03.117660 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":107,"threads_started":1}
I20260809 02:24:03.117861 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.108543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55118 (local address 127.1.81.193:40289)
0809 02:24:03.109203 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.109213 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.109233 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:24:03.109290 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.109295 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.109466 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.109600 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:03.110405 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.111296 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.112216 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.112584 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.112682 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.114718 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:03.114727 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:03.114735 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:03.114756 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:03.116166 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.116588 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.116593 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.116594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.116678 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.116925 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.116928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.116930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.117138 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:03.117254 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.117568 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.117725 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":78,"threads_started":1}
I20260809 02:24:03.118718 25782 tablet_service.cc:1514] Processing DeleteTablet for tablet 0593902e98e549caa529002062c838f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:42 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55118
I20260809 02:24:03.119415 25888 tablet_replica.cc:330] stopping tablet replica
I20260809 02:24:03.119670 25888 raft_consensus.cc:2229] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:03.119907 25888 raft_consensus.cc:2258] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:03.120733 25888 ts_tablet_manager.cc:1905] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:03.123937 25888 ts_tablet_manager.cc:1918] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:03.124015 25888 log.cc:1196] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal/wals/0593902e98e549caa529002062c838f6
I20260809 02:24:03.124235 25888 ts_tablet_manager.cc:1939] T 0593902e98e549caa529002062c838f6 P 36ae59f2d4cd4ed98ba1622d30abe175: Deleting consensus metadata
I20260809 02:24:03.125624 25580 catalog_manager.cc:4841] TS 36ae59f2d4cd4ed98ba1622d30abe175 (127.1.81.193:40289): tablet 0593902e98e549caa529002062c838f6 (table test-table [id=6afabca1780d4cee8bb3533d9382e758]) successfully deleted
W20260809 02:24:03.205499 25879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:03.205720 25879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:03.205777 25879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:03.209723 25879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:03.209774 25879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:03.209848 25879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:24:03.214965 25879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:40401
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=37335
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:03.215839 25879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:03.216706 25879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:03.225593 25899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:03.225673 25895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:03.225692 25896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:03.225968 25879 server_base.cc:1034] running on GCE node
I20260809 02:24:03.226341 25879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:03.226878 25879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:03.228031 25879 hybrid_clock.cc:648] HybridClock initialized: now 1786242243228012 us; error 30 us; skew 500 ppm
Aug 09 02:24:03 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:03.230455 25879 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:24:03.231191 25879 webserver.cc:460] Webserver started at http://127.1.81.194:37335/ using document root <none> and password file <none>
I20260809 02:24:03.231660 25879 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:03.231731 25879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:03.235435 25879 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:24:03.237334 25907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:03.238462 25879 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:24:03.238555 25879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "8f46619b6d13485f86be00cde238823c"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "94795b619fcadd478e5738726d29b1cc"
server_key_iv: "a6378edae8afe25ddd8231f4035eef36"
server_key_version: "encryptionkey@0"
I20260809 02:24:03.239017 25879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:03.250757 25879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:03.253499 25879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:03.253633 25879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:03.254098 25879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:03.254820 25879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:03.254868 25879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:03.254901 25879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:03.254922 25879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:03.263151 25879 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:40401
I20260809 02:24:03.263183 26059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:40401 every 8 connection(s)
I20260809 02:24:03.264055 25879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:24:03.269210 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 25879
I20260809 02:24:03.269598 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:37289
--local_ip_for_outbound_sockets=127.1.81.195
--tserver_master_addrs=127.1.81.254:34593
--webserver_port=34449
--webserver_interface=127.1.81.195
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:24:03 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:03.276621 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.265602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:53167 (local address 127.1.81.254:34593)
0809 02:24:03.265743 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.265747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.266866 (+ 1119us) server_negotiation.cc:407] Connection header received
0809 02:24:03.267692 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.267695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.267755 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.267852 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:03.268908 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.269478 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.270626 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.270867 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.270957 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.273440 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:03.273442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:03.273444 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:03.273469 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:03.274741 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.275197 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.275201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.275203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.275279 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.275581 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.275585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.275586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.275766 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:03.275873 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.276330 (+ 457us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.276459 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:24:03.277318 26064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.265922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:53167)
0809 02:24:03.266733 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.266771 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:03.267493 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:03.268003 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:03.268010 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:03.268350 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:03.268766 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.268779 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.269602 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.269604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.270500 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.270511 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.271007 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.271011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.271218 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.271720 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:03.271740 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:03.273285 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:03.274850 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:03.274856 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:03.274869 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:03.275106 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:03.275360 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:03.275363 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:03.275365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:03.275493 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:03.275876 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:03.275883 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:03.276100 (+ 217us) client_negotiation.cc:769] Sending connection context
0809 02:24:03.276265 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 02:24:03.276545 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":499,"threads_started":1}
I20260809 02:24:03.278360 26060 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34593
I20260809 02:24:03.278600 26060 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:03.279137 26060 heartbeater.cc:511] Master 127.1.81.254:34593 requested a full tablet report, sending...
I20260809 02:24:03.280229 25611 ts_manager.cc:194] Registered new tserver with Master: 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401)
I20260809 02:24:03.280764 25611 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:53167
W20260809 02:24:03.378460 26065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:03.378679 26065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:03.378723 26065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:03.382678 26065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:03.382730 26065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:03.382797 26065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:24:03.387706 26065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:37289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=34449
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:03.388571 26065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:03.389461 26065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:03.398203 26072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:03.398307 26073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:03.398409 26065 server_base.cc:1034] running on GCE node
W20260809 02:24:03.398332 26075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:03.398838 26065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:03.399379 26065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:03.400530 26065 hybrid_clock.cc:648] HybridClock initialized: now 1786242243400515 us; error 25 us; skew 500 ppm
Aug 09 02:24:03 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:03.402976 26065 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:24:03.403766 26065 webserver.cc:460] Webserver started at http://127.1.81.195:34449/ using document root <none> and password file <none>
I20260809 02:24:03.404277 26065 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:03.404361 26065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:03.407738 26065 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 02:24:03.409744 26086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:03.411018 26065 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:03.411147 26065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "6b9700297ebf4930b1b2865ab87bed22"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "4cb47bc304ccdb3c0ae0c6de31e2dfce"
server_key_iv: "825c8724c85ac45b07a46bb07502b150"
server_key_version: "encryptionkey@0"
I20260809 02:24:03.411664 26065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:03.439420 26065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:03.441890 26065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:03.442046 26065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:03.442622 26065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:03.443373 26065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:03.443420 26065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:03.443468 26065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:03.443495 26065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:03.451833 26065 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:37289
I20260809 02:24:03.451895 26235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:37289 every 8 connection(s)
I20260809 02:24:03.452716 26065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:24:03.456326 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 26065
Aug 09 02:24:03 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:03.464727 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.456916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36542 (local address 127.1.81.254:34593)
0809 02:24:03.457132 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.457137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.457313 (+ 176us) server_negotiation.cc:407] Connection header received
0809 02:24:03.457434 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.457437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.457479 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.457551 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:03.458232 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.458743 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.459557 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.459787 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.459902 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.461131 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:03.461134 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:03.461137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:03.461162 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:03.462588 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.463520 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.463523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.463524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.463624 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.463909 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.463912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.463914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.464083 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:03.464268 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.464441 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.464550 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":69,"threads_started":1}
I20260809 02:24:03.465018 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.454228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:33397 (local address 127.1.81.254:34593)
0809 02:24:03.454359 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.454363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.455172 (+ 809us) server_negotiation.cc:407] Connection header received
0809 02:24:03.456378 (+ 1206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.456382 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.456439 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.456511 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:03.457755 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.458272 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.459347 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.459563 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.459649 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.461843 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:03.461846 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:03.461847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:03.461881 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:03.463054 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.463572 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.463576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.463578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.463665 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.464025 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.464028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.464030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.464193 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:03.464276 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.464784 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.464892 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:24:03.465821 26244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.454599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:33397)
0809 02:24:03.455024 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.455063 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:03.456178 (+ 1115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:03.456705 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:03.456714 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:03.457180 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:03.457607 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.457620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.458389 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.458392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.459233 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.459243 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.459701 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.459706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.459891 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.460352 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:03.460367 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:03.461696 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:03.463171 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:03.463176 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:03.463188 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:03.463494 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:03.463751 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:03.463754 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:03.463756 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:03.463935 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:03.464294 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:03.464300 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:03.464508 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 02:24:03.464699 (+ 191us) client_negotiation.cc:240] Negotiation successful
0809 02:24:03.464995 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":117,"threads_started":1}
I20260809 02:24:03.466741 26241 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34593
I20260809 02:24:03.466921 26241 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:03.467303 26241 heartbeater.cc:511] Master 127.1.81.254:34593 requested a full tablet report, sending...
I20260809 02:24:03.468176 25611 ts_manager.cc:194] Registered new tserver with Master: 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
I20260809 02:24:03.468669 25611 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:33397
I20260809 02:24:03.477862 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:24:03.481513 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.478382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36552 (local address 127.1.81.254:34593)
0809 02:24:03.478491 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.478495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.478655 (+ 160us) server_negotiation.cc:407] Connection header received
0809 02:24:03.478793 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.478795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.478874 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.478954 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:24:03.479171 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.479624 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.480482 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.480711 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.480794 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.481094 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:24:03.481196 (+ 102us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 02:24:03.481406 (+ 210us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36552: token expired
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:24:03.481575 25875 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36552: token expired
W20260809 02:24:03.481868 25498 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.81.254:34593)
I20260809 02:24:03.487733 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.482176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36568 (local address 127.1.81.254:34593)
0809 02:24:03.482268 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.482272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.482282 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:24:03.482356 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.482357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.482387 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.482443 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:03.482923 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.483353 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.484106 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.484310 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.484388 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.485381 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:03.485383 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:03.485385 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:03.485398 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:03.486648 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.486963 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.486965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.486966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.487030 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:03.487197 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:03.487198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:03.487199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:03.487330 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:03.487418 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.487551 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.487628 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 02:24:03.489711 25611 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:24:03.492736 25611 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:24:03.499836 25782 tablet_service.cc:1467] Processing CreateTablet for tablet a492ea361246490cbc7e1c6c66537b9b (DEFAULT_TABLE table=test-table [id=2e3d7a2dceb14abda741b349db68d404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:03.500476 25782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a492ea361246490cbc7e1c6c66537b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:03.503208 25722 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Bootstrap starting.
I20260809 02:24:03.503490 25884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.498687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40401 (local address 127.0.0.1:35934)
0809 02:24:03.498789 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.498803 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:03.498876 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:03.499843 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:03.499846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:03.499868 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:03.499953 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.499960 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.501280 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.501284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.502317 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.502328 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.503097 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.503101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.503194 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.503233 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 02:24:03.503302 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:24:03.503377 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 02:24:03.503790 26253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.498877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35934 (local address 127.1.81.194:40401)
0809 02:24:03.499329 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.499341 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.499366 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:24:03.499442 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.499448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.499657 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.499837 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:03.500102 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.501165 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.502434 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.502985 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.503082 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.503231 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.503387 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.503480 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":125,"threads_started":1}
I20260809 02:24:03.504103 25722 tablet_bootstrap.cc:654] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:03.505014 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.498995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:37289 (local address 127.0.0.1:55412)
0809 02:24:03.499329 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.499341 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:03.499422 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:03.500305 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:03.500308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:03.500328 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:03.500413 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.500419 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.502043 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.502046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.503120 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.503132 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.504628 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.504632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.504730 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.504754 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:24:03.504832 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:24:03.504896 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":85,"threads_started":1}
I20260809 02:24:03.505090 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.499351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55412 (local address 127.1.81.195:37289)
0809 02:24:03.499652 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.499662 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.499683 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:24:03.499749 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.499754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.500163 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.500315 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:03.500519 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.501914 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.503276 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.504501 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.504620 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.504745 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.504861 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.504953 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":113,"threads_started":1}
I20260809 02:24:03.506608 25722 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: No bootstrap required, opened a new log
I20260809 02:24:03.506714 25722 ts_tablet_manager.cc:1397] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 02:24:03.506733 25966 tablet_service.cc:1467] Processing CreateTablet for tablet a492ea361246490cbc7e1c6c66537b9b (DEFAULT_TABLE table=test-table [id=2e3d7a2dceb14abda741b349db68d404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:03.507144 25722 raft_consensus.cc:348] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.507253 25722 raft_consensus.cc:374] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:03.507288 25722 raft_consensus.cc:729] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36ae59f2d4cd4ed98ba1622d30abe175, State: Initialized, Role: FOLLOWER
I20260809 02:24:03.507450 25722 consensus_queue.cc:260] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.507823 25966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a492ea361246490cbc7e1c6c66537b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:03.508109 26147 tablet_service.cc:1467] Processing CreateTablet for tablet a492ea361246490cbc7e1c6c66537b9b (DEFAULT_TABLE table=test-table [id=2e3d7a2dceb14abda741b349db68d404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:03.509124 26147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a492ea361246490cbc7e1c6c66537b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:03.509186 25722 ts_tablet_manager.cc:1428] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:24:03.514818 26257 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Bootstrap starting.
I20260809 02:24:03.515447 26259 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Bootstrap starting.
I20260809 02:24:03.517598 26259 tablet_bootstrap.cc:654] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:03.518059 26257 tablet_bootstrap.cc:654] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:03.518836 26257 log.cc:824] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:03.518836 26259 log.cc:824] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:03.520850 26257 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: No bootstrap required, opened a new log
I20260809 02:24:03.520852 26259 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: No bootstrap required, opened a new log
I20260809 02:24:03.521044 26259 ts_tablet_manager.cc:1397] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:24:03.521044 26257 ts_tablet_manager.cc:1397] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:24:03.524777 26259 raft_consensus.cc:348] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.524777 26257 raft_consensus.cc:348] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.525046 26257 raft_consensus.cc:374] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:03.525046 26259 raft_consensus.cc:374] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:03.525107 26257 raft_consensus.cc:729] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f46619b6d13485f86be00cde238823c, State: Initialized, Role: FOLLOWER
I20260809 02:24:03.525107 26259 raft_consensus.cc:729] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b9700297ebf4930b1b2865ab87bed22, State: Initialized, Role: FOLLOWER
I20260809 02:24:03.525549 26259 consensus_queue.cc:260] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.525549 26257 consensus_queue.cc:260] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.526175 26060 heartbeater.cc:503] Master 127.1.81.254:34593 was elected leader, sending a full tablet report...
I20260809 02:24:03.526360 26241 heartbeater.cc:503] Master 127.1.81.254:34593 was elected leader, sending a full tablet report...
I20260809 02:24:03.526502 26259 ts_tablet_manager.cc:1428] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:24:03.527336 26257 ts_tablet_manager.cc:1428] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260809 02:24:03.583206 25874 tablet.cc:2369] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:24:03.703570 26243 tablet.cc:2369] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:24:03.765105 26062 tablet.cc:2369] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:03.874822 25882 raft_consensus.cc:482] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:03.875011 25882 raft_consensus.cc:504] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.876070 25882 leader_election.cc:288] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401), 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
I20260809 02:24:03.879791 26253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.876405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:57703 (local address 127.1.81.194:40401)
0809 02:24:03.876540 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.876546 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.876648 (+ 102us) server_negotiation.cc:407] Connection header received
0809 02:24:03.876858 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.876863 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.876912 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.876953 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:03.877309 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.877796 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.878851 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.879250 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.879357 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.879410 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.879598 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.879671 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:24:03.879837 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.876286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40401 (local address 127.1.81.193:57703)
0809 02:24:03.876539 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.876554 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:03.876699 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:03.877074 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:03.877076 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:03.877092 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:03.877194 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.877198 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.877903 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.877907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.878721 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.878730 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.879362 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.879366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.879461 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.879498 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:24:03.879565 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:24:03.879637 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":22,"thread_start_us":76,"threads_started":1}
I20260809 02:24:03.879860 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.876791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:38857 (local address 127.1.81.195:37289)
0809 02:24:03.876919 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.876923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.876963 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:24:03.877112 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.877115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.877171 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.877231 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:03.877466 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.877951 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.878934 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.879336 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.879440 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.879491 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.879652 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.879718 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:24:03.879890 26270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.876628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:37289 (local address 127.1.81.193:38857)
0809 02:24:03.876896 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.876909 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:03.877010 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:03.877255 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:03.877258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:03.877274 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:03.877362 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.877367 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.878057 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.878061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.878809 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:03.878818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.879448 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.879452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:03.879541 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.879560 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:24:03.879623 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:24:03.879703 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":75,"threads_started":1}
I20260809 02:24:03.880545 26179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a492ea361246490cbc7e1c6c66537b9b" candidate_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b9700297ebf4930b1b2865ab87bed22" is_pre_election: true
I20260809 02:24:03.880545 25996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a492ea361246490cbc7e1c6c66537b9b" candidate_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f46619b6d13485f86be00cde238823c" is_pre_election: true
I20260809 02:24:03.880853 26179 raft_consensus.cc:2454] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36ae59f2d4cd4ed98ba1622d30abe175 in term 0.
I20260809 02:24:03.880853 25996 raft_consensus.cc:2454] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36ae59f2d4cd4ed98ba1622d30abe175 in term 0.
I20260809 02:24:03.881310 25714 leader_election.cc:302] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36ae59f2d4cd4ed98ba1622d30abe175, 6b9700297ebf4930b1b2865ab87bed22; no voters:
I20260809 02:24:03.881574 25882 raft_consensus.cc:2781] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:24:03.881657 25882 raft_consensus.cc:482] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:24:03.881702 25882 raft_consensus.cc:3037] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:03.882766 25882 raft_consensus.cc:504] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.883056 25882 leader_election.cc:288] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 1 election: Requested vote from peers 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401), 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
I20260809 02:24:03.883422 25996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a492ea361246490cbc7e1c6c66537b9b" candidate_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f46619b6d13485f86be00cde238823c"
I20260809 02:24:03.883466 26179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a492ea361246490cbc7e1c6c66537b9b" candidate_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b9700297ebf4930b1b2865ab87bed22"
I20260809 02:24:03.883563 25996 raft_consensus.cc:3037] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:03.883571 26179 raft_consensus.cc:3037] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:03.884865 25996 raft_consensus.cc:2454] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36ae59f2d4cd4ed98ba1622d30abe175 in term 1.
I20260809 02:24:03.884865 26179 raft_consensus.cc:2454] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36ae59f2d4cd4ed98ba1622d30abe175 in term 1.
I20260809 02:24:03.885167 25714 leader_election.cc:302] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36ae59f2d4cd4ed98ba1622d30abe175, 6b9700297ebf4930b1b2865ab87bed22; no voters:
I20260809 02:24:03.885315 25882 raft_consensus.cc:2781] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:03.885533 25882 raft_consensus.cc:686] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 LEADER]: Becoming Leader. State: Replica: 36ae59f2d4cd4ed98ba1622d30abe175, State: Running, Role: LEADER
I20260809 02:24:03.885774 25882 consensus_queue.cc:237] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:03.888453 25609 catalog_manager.cc:5495] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36ae59f2d4cd4ed98ba1622d30abe175 (127.1.81.193). New cstate: current_term: 1 leader_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } health_report { overall_health: HEALTHY } } }
I20260809 02:24:03.949535 26274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.946498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55130 (local address 127.1.81.193:40289)
0809 02:24:03.946763 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:03.946770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:03.946782 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:24:03.946846 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:03.946848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:03.946898 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:03.946991 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:24:03.947150 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.947626 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.948381 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:03.948585 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:03.948657 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:03.948833 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:24:03.949210 (+ 377us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:24:03.949290 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:03.949339 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 02:24:03.949387 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":102,"threads_started":1}
I20260809 02:24:03.953202 25996 raft_consensus.cc:1261] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 1 FOLLOWER]: Refusing update from remote peer 36ae59f2d4cd4ed98ba1622d30abe175: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:03.953202 26179 raft_consensus.cc:1261] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 1 FOLLOWER]: Refusing update from remote peer 36ae59f2d4cd4ed98ba1622d30abe175: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:03.953877 26271 consensus_queue.cc:1035] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:03.954069 25882 consensus_queue.cc:1035] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:03.961227 26279 mvcc.cc:205] Tried to move back new op lower bound from 7316448231226044416 to 7316448230958313472. Current Snapshot: MvccSnapshot[applied={T|T < 7316448231226044416}]
I20260809 02:24:03.961926 26275 mvcc.cc:205] Tried to move back new op lower bound from 7316448231226044416 to 7316448230958313472. Current Snapshot: MvccSnapshot[applied={T|T < 7316448231226044416 or (T in {7316448231226044416})}]
I20260809 02:24:03.963451 26278 mvcc.cc:205] Tried to move back new op lower bound from 7316448231226044416 to 7316448230958313472. Current Snapshot: MvccSnapshot[applied={T|T < 7316448231226044416}]
I20260809 02:24:03.969657 25611 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:03.969817 25611 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:03.971988 25611 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Sending DeleteTablet for 3 replicas of tablet a492ea361246490cbc7e1c6c66537b9b
I20260809 02:24:03.972656 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 25665
I20260809 02:24:03.972643 25782 tablet_service.cc:1514] Processing DeleteTablet for tablet a492ea361246490cbc7e1c6c66537b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:03 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55118
I20260809 02:24:03.972630 26147 tablet_service.cc:1514] Processing DeleteTablet for tablet a492ea361246490cbc7e1c6c66537b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:03 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55412
I20260809 02:24:03.980894 25966 tablet_service.cc:1514] Processing DeleteTablet for tablet a492ea361246490cbc7e1c6c66537b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:03 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:35934
I20260809 02:24:03.981338 26288 tablet_replica.cc:330] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: stopping tablet replica
I20260809 02:24:03.981338 26287 tablet_replica.cc:330] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: stopping tablet replica
I20260809 02:24:03.981631 26288 raft_consensus.cc:2229] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:03.981631 26287 raft_consensus.cc:2229] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:03.981927 26288 raft_consensus.cc:2258] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:03.981928 26287 raft_consensus.cc:2258] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:03.983317 26287 ts_tablet_manager.cc:1905] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:03.983317 26288 ts_tablet_manager.cc:1905] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:03.985905 26287 ts_tablet_manager.cc:1918] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:03.985905 26288 ts_tablet_manager.cc:1918] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:03.986007 26287 log.cc:1196] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/a492ea361246490cbc7e1c6c66537b9b
I20260809 02:24:03.986007 26288 log.cc:1196] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/a492ea361246490cbc7e1c6c66537b9b
I20260809 02:24:03.986322 26288 ts_tablet_manager.cc:1939] T a492ea361246490cbc7e1c6c66537b9b P 8f46619b6d13485f86be00cde238823c: Deleting consensus metadata
I20260809 02:24:03.986322 26287 ts_tablet_manager.cc:1939] T a492ea361246490cbc7e1c6c66537b9b P 6b9700297ebf4930b1b2865ab87bed22: Deleting consensus metadata
I20260809 02:24:03.987438 25582 catalog_manager.cc:4841] TS 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401): tablet a492ea361246490cbc7e1c6c66537b9b (table test-table [id=2e3d7a2dceb14abda741b349db68d404]) successfully deleted
I20260809 02:24:03.987612 25582 catalog_manager.cc:4841] TS 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289): tablet a492ea361246490cbc7e1c6c66537b9b (table test-table [id=2e3d7a2dceb14abda741b349db68d404]) successfully deleted
W20260809 02:24:03.987687 25580 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:40289 (error 108)
I20260809 02:24:03.988507 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 25879
I20260809 02:24:03.988582 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:03.988313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:40289 (local address 127.0.0.1:55134)
0809 02:24:03.988431 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:03.988503 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:40289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 02:24:03.996029 25580 catalog_manager.cc:4584] TS 36ae59f2d4cd4ed98ba1622d30abe175 (127.1.81.193:40289): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a492ea361246490cbc7e1c6c66537b9b: Network error: Client connection negotiation failed: client connection to 127.1.81.193:40289: connect: Connection refused (error 111)
I20260809 02:24:04.001032 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 26065
I20260809 02:24:04.012825 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 25549
I20260809 02:24:24.025872 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34593
--webserver_interface=127.1.81.254
--webserver_port=39723
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:34593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:24.133587 26292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:24.133806 26292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:24.133845 26292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:24.137706 26292 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:24:24.137753 26292 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:24:24.137768 26292 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:24:24.137782 26292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:24.137814 26292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:24.137842 26292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:24.137871 26292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:24.137898 26292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:24.142859 26292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:34593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=39723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:24.143702 26292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:24.144666 26292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:24.152561 26307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:24.152572 26302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:24.152655 26303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:24.152736 26292 server_base.cc:1034] running on GCE node
I20260809 02:24:24.153343 26292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:24.154290 26292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:24.155447 26292 hybrid_clock.cc:648] HybridClock initialized: now 1786242264155425 us; error 36 us; skew 500 ppm
Aug 09 02:24:24 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242264, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:24.161511 26292 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:24:24.162439 26292 webserver.cc:460] Webserver started at http://127.1.81.254:39723/ using document root <none> and password file <none>
I20260809 02:24:24.163040 26292 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:24.163105 26292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:24.166637 26292 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:24.168546 26316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:24.169632 26292 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:24.169745 26292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "15b42d5131c64021b8fdc1e7850d1959"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "74897e9063aa0e28ba702ae15f015a96"
server_key_iv: "9c6f352300648da0fabe9614f82b4a9e"
server_key_version: "encryptionkey@0"
I20260809 02:24:24.170220 26292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:24.183640 26292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:24.186195 26292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:24.186359 26292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:24.193274 26292 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:34593
I20260809 02:24:24.193504 26389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:34593 every 8 connection(s)
I20260809 02:24:24.194242 26292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:24.198185 26391 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:24:24.199685 26391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Bootstrap starting.
I20260809 02:24:24.202378 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 26292
I20260809 02:24:24.202777 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:40289
--local_ip_for_outbound_sockets=127.1.81.193
--tserver_master_addrs=127.1.81.254:34593
--webserver_port=36135
--webserver_interface=127.1.81.193
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:24:24.216841 26391 log.cc:824] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:24.227360 26391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:24:24.227666 26391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: Bootstrap complete.
I20260809 02:24:24.231340 26391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:24:24.231730 26391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15b42d5131c64021b8fdc1e7850d1959, State: Initialized, Role: FOLLOWER
I20260809 02:24:24.232211 26391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:24:24.232340 26391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:24.232407 26391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:24.232504 26391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:24:24.234230 26391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:24:24.234531 26391 leader_election.cc:302] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15b42d5131c64021b8fdc1e7850d1959; no voters:
I20260809 02:24:24.234800 26391 leader_election.cc:288] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 02:24:24.234910 26399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:24:24.235162 26399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [term 3 LEADER]: Becoming Leader. State: Replica: 15b42d5131c64021b8fdc1e7850d1959, State: Running, Role: LEADER
I20260809 02:24:24.235512 26399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } }
I20260809 02:24:24.235947 26391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:24.236876 26402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15b42d5131c64021b8fdc1e7850d1959. Latest consensus state: current_term: 3 leader_uuid: "15b42d5131c64021b8fdc1e7850d1959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } } }
I20260809 02:24:24.236999 26402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:24.237702 26401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "15b42d5131c64021b8fdc1e7850d1959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15b42d5131c64021b8fdc1e7850d1959" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34593 } } }
I20260809 02:24:24.237789 26401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:24.240641 26424 catalog_manager.cc:1259] Loaded cluster ID: 7d2921f0ae294b52b2c1e94ddddb6df9
I20260809 02:24:24.240700 26424 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: loading cluster ID for follower catalog manager: success
I20260809 02:24:24.243111 26424 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 15b42d5131c64021b8fdc1e7850d1959: acquiring CA information for follower catalog manager: success
F20260809 02:24:24.244364 26424 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f78ef7419ad google::LogMessage::Fail() at ??:0
@ 0x7f78ef74488a google::LogMessage::SendToLog() at ??:0
@ 0x7f78ef7414de google::LogMessage::Flush() at ??:0
@ 0x7f78ef742a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f78f240518d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f78fa0a6989 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f78fa083023 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f78fa08354b kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f78fa07c652 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f78fa07b9e9 _ZZN4kudu6master21CatalogManagerBgTasks4InitEvENKUlvE_clEv at ??:0
@ 0x7f78fa0c2541 _ZNSt17_Function_handlerIFvvEZN4kudu6master21CatalogManagerBgTasks4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f78f1984512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f78f2fc86db start_thread at ??:0
@ 0x7f78ee23f61f clone at ??:0
W20260809 02:24:24.332903 26396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:24.333119 26396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:24.333160 26396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:24.337023 26396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:24.337077 26396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:24.337136 26396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:24:24.342024 26396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:40289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=36135
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:24.342897 26396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:24.343786 26396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:24.352892 26451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:24.352866 26453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:24.352877 26449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:24.353287 26396 server_base.cc:1034] running on GCE node
I20260809 02:24:24.353789 26396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:24.354522 26396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:24.355733 26396 hybrid_clock.cc:648] HybridClock initialized: now 1786242264355708 us; error 32 us; skew 500 ppm
Aug 09 02:24:24 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242264, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:24.359030 26396 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:24:24.360072 26396 webserver.cc:460] Webserver started at http://127.1.81.193:36135/ using document root <none> and password file <none>
I20260809 02:24:24.360759 26396 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:24.360858 26396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:24.365628 26396 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:24:24.368189 26464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:24.369597 26396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:24:24.369729 26396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "36ae59f2d4cd4ed98ba1622d30abe175"
format_stamp: "Formatted at 2026-08-09 02:23:41 on dist-test-slave-jlzn"
server_key: "e4325b1c8693c751ff40cac21651f63e"
server_key_iv: "3cd9d40c4d47c87998b905c3df5c8657"
server_key_version: "encryptionkey@0"
I20260809 02:24:24.370381 26396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:24.391736 26396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:24.395141 26396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:24.395334 26396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:24.396075 26396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:24.397348 26475 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:24:24.401213 26396 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:24:24.401290 26396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260809 02:24:24.401348 26396 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:24:24.403394 26396 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:24:24.403457 26396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 02:24:24.403709 26475 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Bootstrap starting.
I20260809 02:24:24.414347 26396 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:40289
I20260809 02:24:24.414572 26622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:40289 every 8 connection(s)
I20260809 02:24:24.415583 26396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:24:24.419672 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 26396
I20260809 02:24:24.420207 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:40401
--local_ip_for_outbound_sockets=127.1.81.194
--tserver_master_addrs=127.1.81.254:34593
--webserver_port=37335
--webserver_interface=127.1.81.194
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:24:24.423684 26475 log.cc:824] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:24.436810 26475 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:24:24.437230 26475 tablet_bootstrap.cc:492] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Bootstrap complete.
I20260809 02:24:24.438728 26475 ts_tablet_manager.cc:1397] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Time spent bootstrapping tablet: real 0.035s user 0.021s sys 0.007s
I20260809 02:24:24.441990 26475 raft_consensus.cc:348] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:24.442512 26475 raft_consensus.cc:729] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36ae59f2d4cd4ed98ba1622d30abe175, State: Initialized, Role: FOLLOWER
I20260809 02:24:24.443084 26475 consensus_queue.cc:260] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:24.444124 26475 ts_tablet_manager.cc:1428] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
W20260809 02:24:24.459635 26625 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:24:24.417735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:42953)
0809 02:24:24.418299 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.418370 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:24.419456 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:24.458778 (+ 39322us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":137,"threads_started":1}
W20260809 02:24:24.460173 26623 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:34593 (0 consecutive failures): Network error: Failed to ping master at 127.1.81.254:34593: Client connection negotiation failed: client connection to 127.1.81.254:34593: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:24:24.460878 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:24.460622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:56829)
0809 02:24:24.460745 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.460815 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 02:24:24.461524 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:24.461317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:37763)
0809 02:24:24.461418 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.461468 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 02:24:24.461715 26623 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:24:24.530099 26626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:24.530304 26626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:24.530344 26626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:24.534175 26626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:24.534220 26626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:24.534272 26626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:24:24.539063 26626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:40401
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=37335
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:24.539906 26626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:24.540759 26626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:24.549327 26638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:24.549356 26635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:24.549356 26633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:24.549957 26626 server_base.cc:1034] running on GCE node
I20260809 02:24:24.550326 26626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:24.550868 26626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:24.552021 26626 hybrid_clock.cc:648] HybridClock initialized: now 1786242264552002 us; error 29 us; skew 500 ppm
Aug 09 02:24:24 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242264, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:24.554467 26626 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:24:24.555200 26626 webserver.cc:460] Webserver started at http://127.1.81.194:37335/ using document root <none> and password file <none>
I20260809 02:24:24.555680 26626 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:24.555745 26626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:24.559201 26626 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:24:24.561044 26645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:24.562068 26626 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:24:24.562194 26626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "8f46619b6d13485f86be00cde238823c"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "94795b619fcadd478e5738726d29b1cc"
server_key_iv: "a6378edae8afe25ddd8231f4035eef36"
server_key_version: "encryptionkey@0"
I20260809 02:24:24.562644 26626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:24.572628 26626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:24.575356 26626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:24.575510 26626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:24.576045 26626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:24.576776 26626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:24.576825 26626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:24.576872 26626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:24.576900 26626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:24.585109 26626 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:40401
I20260809 02:24:24.585175 26810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:40401 every 8 connection(s)
I20260809 02:24:24.585961 26626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:24:24.587281 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 26626
I20260809 02:24:24.587666 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:37289
--local_ip_for_outbound_sockets=127.1.81.195
--tserver_master_addrs=127.1.81.254:34593
--webserver_port=34449
--webserver_interface=127.1.81.195
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:24:24.589757 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:24.587747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:56947)
0809 02:24:24.588262 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.588949 (+ 687us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":115,"threads_started":1}
W20260809 02:24:24.590154 26812 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:34593 (0 consecutive failures): Network error: Failed to ping master at 127.1.81.254:34593: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
I20260809 02:24:24.590705 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:24.590498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:49485)
0809 02:24:24.590600 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.590652 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:24:24.591285 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:24.591089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:46857)
0809 02:24:24.591190 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.591235 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 02:24:24.591445 26812 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:24:24.694182 26816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:24.694381 26816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:24.694420 26816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:24.698339 26816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:24.698387 26816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:24.698441 26816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:24:24.703509 26816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:37289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=34449
--tserver_master_addrs=127.1.81.254:34593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:24.704334 26816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:24.705134 26816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:24:24.713598 26816 server_base.cc:1034] running on GCE node
W20260809 02:24:24.713550 26824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:24.713581 26821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:24.713550 26822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:24.714067 26816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:24.714617 26816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:24.715775 26816 hybrid_clock.cc:648] HybridClock initialized: now 1786242264715763 us; error 25 us; skew 500 ppm
Aug 09 02:24:24 dist-test-slave-jlzn krb5kdc[24732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242264, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:24.718163 26816 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:24:24.718871 26816 webserver.cc:460] Webserver started at http://127.1.81.195:34449/ using document root <none> and password file <none>
I20260809 02:24:24.719302 26816 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:24.719355 26816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:24.722580 26816 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:24.724370 26835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:24.725407 26816 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:24.725497 26816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "6b9700297ebf4930b1b2865ab87bed22"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-jlzn"
server_key: "4cb47bc304ccdb3c0ae0c6de31e2dfce"
server_key_iv: "825c8724c85ac45b07a46bb07502b150"
server_key_version: "encryptionkey@0"
I20260809 02:24:24.725935 26816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:24.739598 26816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:24.741974 26816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:24.742105 26816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:24.742540 26816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:24.743247 26816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:24.743292 26816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:24.743326 26816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:24.743346 26816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:24.751689 26816 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:37289
I20260809 02:24:24.751713 26984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:37289 every 8 connection(s)
I20260809 02:24:24.752556 26816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:24:24.754803 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 26816
I20260809 02:24:24.755913 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:24.754321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:48505)
0809 02:24:24.754731 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.755232 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
W20260809 02:24:24.756361 26986 heartbeater.cc:644] Failed to heartbeat to 127.1.81.254:34593 (0 consecutive failures): Network error: Failed to ping master at 127.1.81.254:34593: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
I20260809 02:24:24.756867 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:24.756674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:43849)
0809 02:24:24.756771 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.756816 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:24:24.757421 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:24.757233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:54219)
0809 02:24:24.757330 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:24.757374 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 02:24:24.757582 26986 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:24:25.462666 26990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:25.462246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:39239)
0809 02:24:25.462477 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:25.462530 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":64,"threads_started":1}
I20260809 02:24:25.592317 26991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:25.591935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:37841)
0809 02:24:25.592171 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:25.592219 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":70,"threads_started":1}
I20260809 02:24:25.758430 26992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:25.758035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:38011)
0809 02:24:25.758262 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:25.758313 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":74,"threads_started":1}
I20260809 02:24:26.261123 26994 raft_consensus.cc:482] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:26.261369 26994 raft_consensus.cc:504] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:26.262428 26994 leader_election.cc:288] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401), 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
Aug 09 02:24:26 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242264, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.195@KRBTEST.COM
Aug 09 02:24:26 dist-test-slave-jlzn krb5kdc[24732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242264, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.194@KRBTEST.COM
I20260809 02:24:26.275544 26996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:26.262632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:40401 (local address 127.1.81.193:53389)
0809 02:24:26.262873 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:26.262888 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:26.263003 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:26.264717 (+ 1714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:26.264723 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:26.265339 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:26.265802 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:26.265820 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:26.267136 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:26.267139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:26.268144 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:26.268156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:26.268822 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:26.268825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:26.268989 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:26.269616 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:26.269629 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:26.271485 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:26.273505 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:26.273507 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:26.273508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:26.273751 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:26.274088 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:26.274091 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:26.274093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:26.274191 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:26.274801 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:26.274803 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:26.274879 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 02:24:26.275035 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 02:24:26.275323 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":108,"spinlock_wait_cycles":2304,"thread_start_us":77,"threads_started":1}
I20260809 02:24:26.275681 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:26.262788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:53389 (local address 127.1.81.194:40401)
0809 02:24:26.263070 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:26.263087 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:26.263140 (+ 53us) server_negotiation.cc:407] Connection header received
0809 02:24:26.263952 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:26.263960 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:26.264348 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:26.264633 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:26.265965 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:26.266986 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:26.268257 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:26.268706 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:26.268853 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:26.271676 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:26.271680 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:26.271690 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:26.271716 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:26.273397 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:26.273856 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:26.273862 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:26.273867 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:26.273997 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:26.274275 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:26.274277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:26.274278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:26.274697 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:26.274822 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:26.275170 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 02:24:26.275489 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":69,"threads_started":1}
I20260809 02:24:26.275728 26999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:26.263255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:40759 (local address 127.1.81.195:37289)
0809 02:24:26.263545 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:26.263555 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:26.263588 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:24:26.264283 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:26.264290 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:26.264688 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:26.264958 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:26.265968 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:26.267015 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:26.268271 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:26.268708 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:26.268853 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:26.271361 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:26.271367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:26.271382 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:26.271415 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:26.273047 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:26.273613 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:26.273619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:26.273625 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:26.273768 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:26.274102 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:26.274105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:26.274107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:26.274517 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:26.274619 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:26.275283 (+ 664us) server_negotiation.cc:299] Negotiation successful
0809 02:24:26.275502 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":73,"threads_started":1}
I20260809 02:24:26.276039 26998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:26.263000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:37289 (local address 127.1.81.193:40759)
0809 02:24:26.263232 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:26.263244 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:26.263330 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:26.265006 (+ 1676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:26.265009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:26.265364 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:26.265802 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:26.265820 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:26.267131 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:26.267135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:26.268157 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:26.268168 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:26.268817 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:26.268821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:26.268988 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:26.269566 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:26.269581 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:26.271127 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:26.273176 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:26.273182 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:26.273195 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:26.273513 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:26.273853 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:26.273856 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:26.273858 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:26.274023 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:26.274622 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:26.274628 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:26.274876 (+ 248us) client_negotiation.cc:769] Sending connection context
0809 02:24:26.275045 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 02:24:26.275922 (+ 877us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":776,"spinlock_wait_cycles":26624,"thread_start_us":53,"threads_started":1}
W20260809 02:24:26.278128 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
W20260809 02:24:26.278322 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
I20260809 02:24:26.278380 26467 leader_election.cc:302] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36ae59f2d4cd4ed98ba1622d30abe175; no voters: 6b9700297ebf4930b1b2865ab87bed22, 8f46619b6d13485f86be00cde238823c
I20260809 02:24:26.278609 26994 raft_consensus.cc:2726] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:24:26.463595 26998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:26.463324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:34031)
0809 02:24:26.463457 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:26.463508 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 02:24:26.593302 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:26.592916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:58489)
0809 02:24:26.593141 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:26.593196 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":70,"threads_started":1}
I20260809 02:24:26.759418 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:26.759032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:35601)
0809 02:24:26.759260 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:26.759312 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":67,"threads_started":1}
I20260809 02:24:27.464751 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:27.464347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:44189)
0809 02:24:27.464578 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:27.464641 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":66,"threads_started":1}
I20260809 02:24:27.594254 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:27.593898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:39219)
0809 02:24:27.594120 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:27.594167 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":71,"threads_started":1}
I20260809 02:24:27.760390 27006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:27.760027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:56049)
0809 02:24:27.760255 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:27.760305 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":69,"threads_started":1}
I20260809 02:24:28.158689 27007 raft_consensus.cc:482] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:28.158814 27007 raft_consensus.cc:504] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:28.159161 27007 leader_election.cc:288] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401), 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
W20260809 02:24:28.159963 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
W20260809 02:24:28.160107 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
I20260809 02:24:28.160233 26467 leader_election.cc:302] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36ae59f2d4cd4ed98ba1622d30abe175; no voters: 6b9700297ebf4930b1b2865ab87bed22, 8f46619b6d13485f86be00cde238823c
I20260809 02:24:28.160393 27007 raft_consensus.cc:2726] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:24:28.465829 27008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:28.465436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:60171)
0809 02:24:28.465682 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:28.465734 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":80,"threads_started":1}
I20260809 02:24:28.595260 27009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:28.594836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:52889)
0809 02:24:28.595097 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:28.595155 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":90,"threads_started":1}
I20260809 02:24:28.761358 27011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:28.760986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:58563)
0809 02:24:28.761224 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:28.761273 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":83,"threads_started":1}
I20260809 02:24:29.467018 27013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:29.466560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:44789)
0809 02:24:29.466863 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:29.466918 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":86,"threads_started":1}
I20260809 02:24:29.596282 27014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:29.595909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:58335)
0809 02:24:29.596127 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:29.596194 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":65,"threads_started":1}
I20260809 02:24:29.762307 27015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:29.761962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:38235)
0809 02:24:29.762173 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:29.762223 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":68,"threads_started":1}
I20260809 02:24:30.468101 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:30.467672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:43603)
0809 02:24:30.467947 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:30.468002 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260809 02:24:30.597255 27017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:30.596881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:36685)
0809 02:24:30.597104 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:30.597165 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":70,"threads_started":1}
I20260809 02:24:30.763274 27019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:30.762899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:57849)
0809 02:24:30.763129 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:30.763187 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":82,"threads_started":1}
I20260809 02:24:31.469138 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:31.468743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:33959)
0809 02:24:31.468987 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:31.469040 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":74,"threads_started":1}
I20260809 02:24:31.481714 27022 raft_consensus.cc:482] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:31.481828 27022 raft_consensus.cc:504] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:31.482242 27022 leader_election.cc:288] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401), 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
W20260809 02:24:31.483000 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
W20260809 02:24:31.483146 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
I20260809 02:24:31.483203 26467 leader_election.cc:302] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36ae59f2d4cd4ed98ba1622d30abe175; no voters: 6b9700297ebf4930b1b2865ab87bed22, 8f46619b6d13485f86be00cde238823c
I20260809 02:24:31.483361 27022 raft_consensus.cc:2726] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:24:31.598261 27023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:31.597841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:36099)
0809 02:24:31.598122 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:31.598175 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":66,"threads_started":1}
I20260809 02:24:31.764289 27024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:31.763890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:50175)
0809 02:24:31.764154 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:31.764205 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":65,"threads_started":1}
I20260809 02:24:32.470135 27025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:32.469763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:58321)
0809 02:24:32.469985 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:32.470037 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":73,"threads_started":1}
I20260809 02:24:32.599254 27026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:32.598872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:37869)
0809 02:24:32.599112 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:32.599164 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":82,"threads_started":1}
I20260809 02:24:32.765244 27030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:32.764859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:50337)
0809 02:24:32.765104 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:32.765157 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":66,"threads_started":1}
I20260809 02:24:33.471263 27031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:33.470846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:51569)
0809 02:24:33.471097 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:33.471160 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":76,"threads_started":1}
I20260809 02:24:33.600260 27032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:33.599888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:46425)
0809 02:24:33.600110 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:33.600170 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":68,"threads_started":1}
I20260809 02:24:33.766325 27033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:33.765933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:42261)
0809 02:24:33.766182 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:33.766234 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":86,"threads_started":1}
I20260809 02:24:33.874742 27035 raft_consensus.cc:482] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:33.874876 27035 raft_consensus.cc:504] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:33.875315 27035 leader_election.cc:288] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401), 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
W20260809 02:24:33.876080 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
W20260809 02:24:33.876226 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
I20260809 02:24:33.876266 26467 leader_election.cc:302] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36ae59f2d4cd4ed98ba1622d30abe175; no voters: 6b9700297ebf4930b1b2865ab87bed22, 8f46619b6d13485f86be00cde238823c
I20260809 02:24:33.876401 27035 raft_consensus.cc:2726] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:24:34.472395 27036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:34.472006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:54051)
0809 02:24:34.472246 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:34.472299 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":73,"threads_started":1}
I20260809 02:24:34.601243 27037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:34.600863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:42829)
0809 02:24:34.601095 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:34.601155 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":80,"threads_started":1}
I20260809 02:24:34.767282 27038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:34.766913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:53845)
0809 02:24:34.767142 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:34.767198 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":67,"threads_started":1}
I20260809 02:24:35.473393 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:35.473001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:33601)
0809 02:24:35.473244 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:35.473295 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":83,"threads_started":1}
I20260809 02:24:35.602200 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:35.601826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:53307)
0809 02:24:35.602058 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:35.602108 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":82,"threads_started":1}
I20260809 02:24:35.768297 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:35.767921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:33063)
0809 02:24:35.768146 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:35.768208 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":69,"threads_started":1}
I20260809 02:24:36.474417 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:36.474022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:38439)
0809 02:24:36.474263 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:36.474318 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":71,"threads_started":1}
I20260809 02:24:36.603199 27045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:36.602803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:51211)
0809 02:24:36.603048 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:36.603100 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":84,"threads_started":1}
I20260809 02:24:36.769238 27046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:36.768872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:52375)
0809 02:24:36.769097 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:36.769147 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":68,"threads_started":1}
I20260809 02:24:37.475451 27047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:37.475054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:55435)
0809 02:24:37.475302 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:37.475354 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":86,"threads_started":1}
I20260809 02:24:37.604218 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:37.603828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:37991)
0809 02:24:37.604069 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:37.604119 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":83,"threads_started":1}
I20260809 02:24:37.770207 27050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:37.769809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:57005)
0809 02:24:37.770047 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:37.770118 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":76,"threads_started":1}
I20260809 02:24:38.476468 27051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:38.476080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:37665)
0809 02:24:38.476320 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:38.476372 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":81,"threads_started":1}
I20260809 02:24:38.605177 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:38.604800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:54847)
0809 02:24:38.605027 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:38.605077 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":70,"threads_started":1}
I20260809 02:24:38.643078 27060 raft_consensus.cc:482] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:38.643196 27060 raft_consensus.cc:504] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f46619b6d13485f86be00cde238823c" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 40401 } } peers { permanent_uuid: "6b9700297ebf4930b1b2865ab87bed22" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 37289 } } peers { permanent_uuid: "36ae59f2d4cd4ed98ba1622d30abe175" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 40289 } }
I20260809 02:24:38.643558 27060 leader_election.cc:288] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401), 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289)
W20260809 02:24:38.644294 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b9700297ebf4930b1b2865ab87bed22 (127.1.81.195:37289): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
W20260809 02:24:38.644410 26467 leader_election.cc:341] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f46619b6d13485f86be00cde238823c (127.1.81.194:40401): Not found: Tablet not found: a492ea361246490cbc7e1c6c66537b9b
I20260809 02:24:38.644445 26467 leader_election.cc:302] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36ae59f2d4cd4ed98ba1622d30abe175; no voters: 6b9700297ebf4930b1b2865ab87bed22, 8f46619b6d13485f86be00cde238823c
I20260809 02:24:38.644588 27060 raft_consensus.cc:2726] T a492ea361246490cbc7e1c6c66537b9b P 36ae59f2d4cd4ed98ba1622d30abe175 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:24:38.771112 27061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:38.770777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:41733)
0809 02:24:38.770980 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:38.771030 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":66,"threads_started":1}
I20260809 02:24:39.477684 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:39.477265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.193:51801)
0809 02:24:39.477523 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:39.477580 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":71,"threads_started":1}
I20260809 02:24:39.606228 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:39.605876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.194:44847)
0809 02:24:39.606079 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:39.606128 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":67,"threads_started":1}
I20260809 02:24:39.757794 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 26396
I20260809 02:24:39.770603 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 26626
I20260809 02:24:39.776026 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:39.775524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34593 (local address 127.1.81.195:58031)
0809 02:24:39.775782 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:39.775929 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.254:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
I20260809 02:24:39.780359 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 26816
2026-08-09T02:24:39Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59612 ms)
[----------] 30 tests from SecurityITest (239238 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:39 dist-test-slave-jlzn krb5kdc[27071](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:39 dist-test-slave-jlzn krb5kdc[27071](info): set up 2 sockets
Aug 09 02:24:39 dist-test-slave-jlzn krb5kdc[27071](info): commencing operation
krb5kdc: starting...
W20260809 02:24:40.912956 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:40 dist-test-slave-jlzn krb5kdc[27071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:24:41.026367 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34273
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:34273
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:41.131862 27087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:41.132078 27087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:41.132118 27087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:41.135973 27087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:41.136019 27087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:41.136039 27087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:41.136068 27087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:41.136096 27087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:41.141086 27087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:34273
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:34273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:41.141939 27087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:41.142814 27087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:41.151077 27098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:41.151110 27087 server_base.cc:1034] running on GCE node
W20260809 02:24:41.151047 27096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:41.151060 27100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:41.152017 27087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:41.153035 27087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:41.154186 27087 hybrid_clock.cc:648] HybridClock initialized: now 1786242281154167 us; error 31 us; skew 500 ppm
Aug 09 02:24:41 dist-test-slave-jlzn krb5kdc[27071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:41.156698 27087 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:24:41.157460 27087 webserver.cc:460] Webserver started at http://127.1.81.254:33855/ using document root <none> and password file <none>
I20260809 02:24:41.157948 27087 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:41.158010 27087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:41.158201 27087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:41.160146 27087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "a9ff3545884a4bee9d0a56bb405d8574"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "b7348e661307ebf3ea44783dabaadce4"
server_key_iv: "e06c832e1603621cc8f1934ba9258ad0"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.160676 27087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "a9ff3545884a4bee9d0a56bb405d8574"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "b7348e661307ebf3ea44783dabaadce4"
server_key_iv: "e06c832e1603621cc8f1934ba9258ad0"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.164017 27087 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:24:41.166124 27109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.167203 27087 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:41.167311 27087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "a9ff3545884a4bee9d0a56bb405d8574"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "b7348e661307ebf3ea44783dabaadce4"
server_key_iv: "e06c832e1603621cc8f1934ba9258ad0"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.167402 27087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:41.181787 27087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:41.184187 27087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:41.184346 27087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:41.190579 27087 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:34273
I20260809 02:24:41.190621 27191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:34273 every 8 connection(s)
I20260809 02:24:41.191390 27087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:41.193951 27192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:41.198978 27192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574: Bootstrap starting.
I20260809 02:24:41.201146 27192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:41.201500 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 27087
I20260809 02:24:41.201618 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:41.201939 1351 external_mini_cluster.cc:1428] Setting key 9d1ea44c392dc1d9c06e52178180f6ce
I20260809 02:24:41.201972 27192 log.cc:824] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:41.204061 27192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574: No bootstrap required, opened a new log
I20260809 02:24:41.208096 27192 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ff3545884a4bee9d0a56bb405d8574" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34273 } }
I20260809 02:24:41.208364 27192 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:41.208434 27192 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ff3545884a4bee9d0a56bb405d8574, State: Initialized, Role: FOLLOWER
I20260809 02:24:41.208875 27192 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ff3545884a4bee9d0a56bb405d8574" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34273 } }
I20260809 02:24:41.209010 27192 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:41.209070 27192 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:41.209175 27192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:41.210191 27192 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ff3545884a4bee9d0a56bb405d8574" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34273 } }
I20260809 02:24:41.210516 27192 leader_election.cc:302] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9ff3545884a4bee9d0a56bb405d8574; no voters:
Aug 09 02:24:41 dist-test-slave-jlzn krb5kdc[27071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:41.210776 27192 leader_election.cc:288] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:41.210875 27198 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:41.211081 27198 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [term 1 LEADER]: Becoming Leader. State: Replica: a9ff3545884a4bee9d0a56bb405d8574, State: Running, Role: LEADER
I20260809 02:24:41.211448 27198 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ff3545884a4bee9d0a56bb405d8574" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34273 } }
I20260809 02:24:41.212041 27192 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:41.214517 27202 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9ff3545884a4bee9d0a56bb405d8574. Latest consensus state: current_term: 1 leader_uuid: "a9ff3545884a4bee9d0a56bb405d8574" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ff3545884a4bee9d0a56bb405d8574" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34273 } } }
I20260809 02:24:41.214658 27202 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:41.214629 27200 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9ff3545884a4bee9d0a56bb405d8574" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ff3545884a4bee9d0a56bb405d8574" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 34273 } } }
I20260809 02:24:41.214735 27200 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574 [sys.catalog]: This master's current role is: LEADER
W20260809 02:24:41.216689 27220 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:24:41.216755 27220 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:24:41.216786 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.202973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54934 (local address 127.1.81.254:34273)
0809 02:24:41.203396 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:41.203414 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:41.203453 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:24:41.204249 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:41.204272 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:41.204640 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:41.204983 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:41.205583 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.207068 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.207892 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.208577 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.208751 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.211400 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:41.211407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:41.211422 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:41.211452 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:41.213448 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.213996 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.214002 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.214007 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.214150 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.214592 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.214596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.214598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.215106 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:41.215262 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:41.215607 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 02:24:41.215913 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":135,"threads_started":1}
I20260809 02:24:41.216832 27221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:41.217644 27221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:41.222136 27221 catalog_manager.cc:1347] Generated new cluster ID: bc0d1eff9f6e4abda305b338610ed5f3
I20260809 02:24:41.222205 27221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:41.236552 27221 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:41.237663 27221 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:41.243981 27221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574: Generated new TSK 0
I20260809 02:24:41.244508 27221 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:24:41.276077 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34273
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:41.383352 27229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:41.383571 27229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:41.383615 27229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:41.387506 27229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:41.387554 27229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:41.387621 27229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:24:41.392618 27229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:41.393483 27229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:41.394388 27229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:41.403261 27238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:41.403271 27235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:41.403297 27236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:41.403395 27229 server_base.cc:1034] running on GCE node
I20260809 02:24:41.403891 27229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:41.404466 27229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:41.405616 27229 hybrid_clock.cc:648] HybridClock initialized: now 1786242281405602 us; error 32 us; skew 500 ppm
Aug 09 02:24:41 dist-test-slave-jlzn krb5kdc[27071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:41.408336 27229 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:24:41.409289 27229 webserver.cc:460] Webserver started at http://127.1.81.193:39339/ using document root <none> and password file <none>
I20260809 02:24:41.409803 27229 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:41.409870 27229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:41.410054 27229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:41.412091 27229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "39d0ebdae43b4241b80694024697a795"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "636060b410f43f18af72bb57f62cdf1f"
server_key_iv: "ab042b29bbbcc8a3e9822508a98f6391"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.412647 27229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "39d0ebdae43b4241b80694024697a795"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "636060b410f43f18af72bb57f62cdf1f"
server_key_iv: "ab042b29bbbcc8a3e9822508a98f6391"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.416229 27229 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:24:41.418385 27251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.419433 27229 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:41.419540 27229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "39d0ebdae43b4241b80694024697a795"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "636060b410f43f18af72bb57f62cdf1f"
server_key_iv: "ab042b29bbbcc8a3e9822508a98f6391"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.419627 27229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:41.428932 27229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:41.431288 27229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:41.431440 27229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:41.432013 27229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:41.432749 27229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:41.432806 27229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.432857 27229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:41.432883 27229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.441036 27229 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:41997
I20260809 02:24:41.441094 27415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:41997 every 8 connection(s)
I20260809 02:24:41.441824 27229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:24:41 dist-test-slave-jlzn krb5kdc[27071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:41.451431 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 27229
I20260809 02:24:41.451563 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:24:41.451877 1351 external_mini_cluster.cc:1428] Setting key 494a4a9e3ade15328558917ddc06f535
I20260809 02:24:41.453572 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.443384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:40467 (local address 127.1.81.254:34273)
0809 02:24:41.443502 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:41.443506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:41.444307 (+ 801us) server_negotiation.cc:407] Connection header received
0809 02:24:41.445054 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:41.445057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:41.445103 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:41.445179 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:41.446142 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.446675 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.447714 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.448040 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.448125 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.450295 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:41.450298 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:41.450300 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:41.450321 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:41.451425 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.451965 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.451969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.451970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.452054 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.452426 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.452430 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.452431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.452651 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:41.452735 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:41.453295 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 02:24:41.453419 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:24:41.454222 27419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.443696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34273 (local address 127.1.81.193:40467)
0809 02:24:41.444160 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:41.444199 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:41.444879 (+ 680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:41.445306 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:41.445312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:41.445622 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:41.446033 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.446046 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.446765 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.446767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.447604 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.447613 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.448162 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.448165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.448299 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.448812 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:41.448827 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:41.450159 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:41.451545 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:41.451551 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:41.451564 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:41.451874 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:41.452138 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:41.452141 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:41.452143 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:41.452314 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:41.452760 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:41.452766 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:41.453031 (+ 265us) client_negotiation.cc:769] Sending connection context
0809 02:24:41.453229 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 02:24:41.453483 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":148,"threads_started":1}
I20260809 02:24:41.455284 27417 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34273
I20260809 02:24:41.455494 27417 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:41.455983 27417 heartbeater.cc:511] Master 127.1.81.254:34273 requested a full tablet report, sending...
I20260809 02:24:41.457341 27140 ts_manager.cc:194] Registered new tserver with Master: 39d0ebdae43b4241b80694024697a795 (127.1.81.193:41997)
I20260809 02:24:41.458397 27140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:40467
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:24:41.476585 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34273
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:41.581385 27422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:41.581583 27422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:41.581621 27422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:41.585489 27422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:41.585536 27422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:41.585587 27422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:24:41.590415 27422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:41.591231 27422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:41.592089 27422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:41.600903 27435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:41.600967 27429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:41.600896 27431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:41.601248 27422 server_base.cc:1034] running on GCE node
I20260809 02:24:41.601606 27422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:41.602166 27422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:41.603309 27422 hybrid_clock.cc:648] HybridClock initialized: now 1786242281603288 us; error 34 us; skew 500 ppm
Aug 09 02:24:41 dist-test-slave-jlzn krb5kdc[27071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:41.605763 27422 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:24:41.606509 27422 webserver.cc:460] Webserver started at http://127.1.81.194:46787/ using document root <none> and password file <none>
I20260809 02:24:41.606989 27422 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:41.607054 27422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:41.607226 27422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:41.609104 27422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "6ca6671bd5fb0dc8f81f97a456883119"
server_key_iv: "d6db5916e1396d0a0bb2f50a263460fb"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.609599 27422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "6ca6671bd5fb0dc8f81f97a456883119"
server_key_iv: "d6db5916e1396d0a0bb2f50a263460fb"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.613052 27422 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:24:41.615270 27444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.616369 27422 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:24:41.616475 27422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "6ca6671bd5fb0dc8f81f97a456883119"
server_key_iv: "d6db5916e1396d0a0bb2f50a263460fb"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.616564 27422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:41.629508 27422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:41.631886 27422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:41.632042 27422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:41.632539 27422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:41.633297 27422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:41.633344 27422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.633394 27422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:41.633420 27422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.641332 27422 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:41003
I20260809 02:24:41.641381 27619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:41003 every 8 connection(s)
I20260809 02:24:41.642102 27422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:24:41 dist-test-slave-jlzn krb5kdc[27071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:41.651867 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 27422
I20260809 02:24:41.651998 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:24:41.652300 1351 external_mini_cluster.cc:1428] Setting key 468c4d31ffd127e2d235bd8e7ca21b33
I20260809 02:24:41.653621 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.643650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:58915 (local address 127.1.81.254:34273)
0809 02:24:41.643828 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:41.643832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:41.644544 (+ 712us) server_negotiation.cc:407] Connection header received
0809 02:24:41.645297 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:41.645300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:41.645349 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:41.645417 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:41.646392 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.646898 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.647939 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.648157 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.648230 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.650289 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:41.650292 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:41.650294 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:41.650319 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:41.651563 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.652115 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.652119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.652121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.652204 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.652560 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.652562 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.652563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.652747 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:41.652834 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:41.653363 (+ 529us) server_negotiation.cc:299] Negotiation successful
0809 02:24:41.653473 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:24:41.654469 27623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.644003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34273 (local address 127.1.81.194:58915)
0809 02:24:41.644407 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:41.644445 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:41.645124 (+ 679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:41.645548 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:41.645554 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:41.645873 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:41.646286 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.646298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.646982 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.646984 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.647850 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.647859 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.648260 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.648262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.648386 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.648837 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:41.648852 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:41.650141 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:41.651663 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:41.651669 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:41.651681 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:41.652024 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:41.652290 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:41.652293 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:41.652295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:41.652466 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:41.652857 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:41.652863 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:41.653109 (+ 246us) client_negotiation.cc:769] Sending connection context
0809 02:24:41.653303 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 02:24:41.653596 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":102,"threads_started":1}
I20260809 02:24:41.655485 27620 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34273
I20260809 02:24:41.655689 27620 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:41.656188 27620 heartbeater.cc:511] Master 127.1.81.254:34273 requested a full tablet report, sending...
I20260809 02:24:41.657074 27140 ts_manager.cc:194] Registered new tserver with Master: 6065a3b06c5f4209bfa7a3927ff4bfd6 (127.1.81.194:41003)
I20260809 02:24:41.657747 27140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:58915
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:24:41.679860 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34273
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:41.786147 27634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:41.786362 27634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:41.786404 27634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:41.790256 27634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:41.790304 27634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:41.790381 27634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:24:41.795267 27634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:34273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:41.796129 27634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:41.796995 27634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:41.805595 27640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:41.805608 27641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:41.805611 27644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:41.805968 27634 server_base.cc:1034] running on GCE node
I20260809 02:24:41.806336 27634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:41.806888 27634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:41.808048 27634 hybrid_clock.cc:648] HybridClock initialized: now 1786242281808028 us; error 28 us; skew 500 ppm
Aug 09 02:24:41 dist-test-slave-jlzn krb5kdc[27071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:41.810549 27634 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:24:41.811297 27634 webserver.cc:460] Webserver started at http://127.1.81.195:43901/ using document root <none> and password file <none>
I20260809 02:24:41.811784 27634 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:41.811887 27634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:41.812071 27634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:41.814013 27634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "931b3ee4a068486ea1cd2afa5201ae13"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "dac8e6fdacf206b5ddc564095cc53a96"
server_key_iv: "510cee7621b2c78ca9266f0880293c97"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.814522 27634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "931b3ee4a068486ea1cd2afa5201ae13"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "dac8e6fdacf206b5ddc564095cc53a96"
server_key_iv: "510cee7621b2c78ca9266f0880293c97"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.817844 27634 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:24:41.819983 27653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.821089 27634 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:24:41.821194 27634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "931b3ee4a068486ea1cd2afa5201ae13"
format_stamp: "Formatted at 2026-08-09 02:24:41 on dist-test-slave-jlzn"
server_key: "dac8e6fdacf206b5ddc564095cc53a96"
server_key_iv: "510cee7621b2c78ca9266f0880293c97"
server_key_version: "encryptionkey@0"
I20260809 02:24:41.821285 27634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:41.833192 27634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:41.835654 27634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:41.835824 27634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:41.836340 27634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:41.837070 27634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:41.837116 27634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.837164 27634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:41.837194 27634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:41.845281 27634 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:42917
I20260809 02:24:41.845342 27811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:42917 every 8 connection(s)
I20260809 02:24:41.846035 27634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:24:41 dist-test-slave-jlzn krb5kdc[27071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:41.854844 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 27634
I20260809 02:24:41.854944 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:24:41.855180 1351 external_mini_cluster.cc:1428] Setting key f0e2ccd786d82c9ff7ef4e2376ef10bc
I20260809 02:24:41.857682 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.847613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:57647 (local address 127.1.81.254:34273)
0809 02:24:41.847751 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:41.847755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:41.848529 (+ 774us) server_negotiation.cc:407] Connection header received
0809 02:24:41.849290 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:41.849293 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:41.849339 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:41.849406 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:41.850393 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.850900 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.851994 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.852209 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.852282 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.854351 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:41.854354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:41.854356 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:41.854379 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:41.855779 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.856294 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.856297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.856298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.856384 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.856707 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.856710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.856712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.856887 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:41.856974 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:41.857417 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 02:24:41.857527 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:24:41.858327 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.847967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:34273 (local address 127.1.81.195:57647)
0809 02:24:41.848380 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:41.848418 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:41.849114 (+ 696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:41.849539 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:41.849545 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:41.849866 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:41.850282 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.850295 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.850984 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.850986 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.851901 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.851911 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.852311 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.852313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.852444 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.852890 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:41.852905 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:41.854206 (+ 1301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:41.855898 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:41.855903 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:41.855916 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:41.856204 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:41.856477 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:41.856479 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:41.856480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:41.856608 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:41.856986 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:41.856992 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:41.857203 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 02:24:41.857359 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 02:24:41.857636 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":105,"threads_started":1}
I20260809 02:24:41.859251 27812 heartbeater.cc:347] Connected to a master server at 127.1.81.254:34273
I20260809 02:24:41.859447 27812 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:41.859903 27812 heartbeater.cc:511] Master 127.1.81.254:34273 requested a full tablet report, sending...
I20260809 02:24:41.860802 27140 ts_manager.cc:194] Registered new tserver with Master: 931b3ee4a068486ea1cd2afa5201ae13 (127.1.81.195:42917)
I20260809 02:24:41.861325 27140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:57647
I20260809 02:24:41.868669 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:24:41.876595 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.870498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.1.81.254:34273)
0809 02:24:41.870591 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:41.870595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:41.870812 (+ 217us) server_negotiation.cc:407] Connection header received
0809 02:24:41.870900 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:41.870902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:41.870937 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:41.870994 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:41.871570 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.872156 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.872911 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.873100 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.873163 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.874250 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:41.874252 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:41.874254 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:41.874268 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:41.875275 (+ 1007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.875608 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.875610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.875611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.875683 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:41.875903 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:41.875905 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:41.875906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:41.876094 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:41.876193 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:41.876372 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 02:24:41.876459 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 02:24:41.878921 27140 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:24:41.881768 27140 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:24:41.895256 27830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.889229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:42917 (local address 127.0.0.1:47406)
0809 02:24:41.889885 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:41.889932 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:41.890053 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:41.890841 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:41.890848 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:41.890869 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:41.891002 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.891009 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.892479 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.892482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.893875 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.893886 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.894879 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.894882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.894969 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.894992 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:24:41.895042 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:24:41.895110 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"mutex_wait_us":70,"thread_start_us":60,"threads_started":1}
I20260809 02:24:41.895265 27835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.889974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55340 (local address 127.1.81.193:41997)
0809 02:24:41.890723 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:41.890734 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:41.890992 (+ 258us) server_negotiation.cc:407] Connection header received
0809 02:24:41.891073 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:41.891078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:41.891261 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:41.891386 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:41.891590 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.892361 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.893830 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.894608 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.894729 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.894874 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:41.895036 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 02:24:41.895124 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":131,"threads_started":1}
I20260809 02:24:41.895290 27828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.889365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:41003 (local address 127.0.0.1:46110)
0809 02:24:41.890069 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:41.890083 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:41.890176 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:41.890942 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:41.890945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:41.890960 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:41.891111 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.891119 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.892524 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.892527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.894008 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.894016 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.894954 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.894958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.895040 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.895061 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:24:41.895120 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:24:41.895177 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":88,"thread_start_us":94,"threads_started":1}
I20260809 02:24:41.895602 27831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.889958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46110 (local address 127.1.81.194:41003)
0809 02:24:41.890499 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:41.890508 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:41.890526 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:24:41.890592 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:41.890597 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:41.890792 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:41.891026 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:41.891195 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.892346 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.894108 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.894643 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.894753 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.894892 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:41.895364 (+ 472us) server_negotiation.cc:299] Negotiation successful
0809 02:24:41.895463 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":105,"threads_started":1}
I20260809 02:24:41.895290 27826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.889595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:41997 (local address 127.0.0.1:55340)
0809 02:24:41.890267 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:41.890279 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:41.890353 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:41.891378 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:41.891381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:41.891398 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:41.891485 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.891491 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.892631 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.892632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.893712 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:41.893722 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.894750 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.894754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:41.894859 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.894894 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 02:24:41.894999 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 02:24:41.895111 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":41,"thread_start_us":93,"threads_started":1}
I20260809 02:24:41.896059 27827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:41.889307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47406 (local address 127.1.81.195:42917)
0809 02:24:41.890394 (+ 1087us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:41.890406 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:41.890428 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:24:41.890494 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:41.890499 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:41.890699 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:41.890853 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:41.891130 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.892346 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.894008 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:41.894751 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:41.895676 (+ 925us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:41.895834 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:41.895881 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 02:24:41.895960 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":998,"thread_start_us":121,"threads_started":1}
I20260809 02:24:41.898286 27722 tablet_service.cc:1467] Processing CreateTablet for tablet b4b4a30df8d348359828d674dab69ac7 (DEFAULT_TABLE table=test-table [id=0d2a66de17a0474baf269df40bc6ddf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:41.898342 27524 tablet_service.cc:1467] Processing CreateTablet for tablet b4b4a30df8d348359828d674dab69ac7 (DEFAULT_TABLE table=test-table [id=0d2a66de17a0474baf269df40bc6ddf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:41.898341 27323 tablet_service.cc:1467] Processing CreateTablet for tablet b4b4a30df8d348359828d674dab69ac7 (DEFAULT_TABLE table=test-table [id=0d2a66de17a0474baf269df40bc6ddf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:41.899191 27722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b4a30df8d348359828d674dab69ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:41.899341 27323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b4a30df8d348359828d674dab69ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:41.899341 27524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b4a30df8d348359828d674dab69ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:41.905606 27836 tablet_bootstrap.cc:492] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: Bootstrap starting.
I20260809 02:24:41.906623 27838 tablet_bootstrap.cc:492] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795: Bootstrap starting.
I20260809 02:24:41.906623 27837 tablet_bootstrap.cc:492] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: Bootstrap starting.
I20260809 02:24:41.907599 27836 tablet_bootstrap.cc:654] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:41.908623 27836 log.cc:824] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:41.909118 27837 tablet_bootstrap.cc:654] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:41.909118 27838 tablet_bootstrap.cc:654] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:41.909958 27838 log.cc:824] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:41.909958 27837 log.cc:824] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:41.910264 27836 tablet_bootstrap.cc:492] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: No bootstrap required, opened a new log
I20260809 02:24:41.910502 27836 ts_tablet_manager.cc:1397] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260809 02:24:41.912002 27837 tablet_bootstrap.cc:492] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: No bootstrap required, opened a new log
I20260809 02:24:41.912277 27837 ts_tablet_manager.cc:1397] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:24:41.912458 27838 tablet_bootstrap.cc:492] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795: No bootstrap required, opened a new log
I20260809 02:24:41.912645 27838 ts_tablet_manager.cc:1397] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:24:41.913857 27836 raft_consensus.cc:348] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:41.914063 27836 raft_consensus.cc:374] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:41.914187 27836 raft_consensus.cc:729] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931b3ee4a068486ea1cd2afa5201ae13, State: Initialized, Role: FOLLOWER
I20260809 02:24:41.914597 27836 consensus_queue.cc:260] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:41.915212 27812 heartbeater.cc:503] Master 127.1.81.254:34273 was elected leader, sending a full tablet report...
I20260809 02:24:41.915455 27836 ts_tablet_manager.cc:1428] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:24:41.916186 27837 raft_consensus.cc:348] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:41.916437 27837 raft_consensus.cc:374] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:41.916530 27837 raft_consensus.cc:729] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6065a3b06c5f4209bfa7a3927ff4bfd6, State: Initialized, Role: FOLLOWER
I20260809 02:24:41.916965 27837 consensus_queue.cc:260] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:41.917304 27838 raft_consensus.cc:348] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:41.917603 27838 raft_consensus.cc:374] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:41.917676 27838 raft_consensus.cc:729] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d0ebdae43b4241b80694024697a795, State: Initialized, Role: FOLLOWER
I20260809 02:24:41.917922 27837 ts_tablet_manager.cc:1428] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:24:41.918241 27620 heartbeater.cc:503] Master 127.1.81.254:34273 was elected leader, sending a full tablet report...
I20260809 02:24:41.918561 27838 consensus_queue.cc:260] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:41.919232 27417 heartbeater.cc:503] Master 127.1.81.254:34273 was elected leader, sending a full tablet report...
I20260809 02:24:41.919504 27838 ts_tablet_manager.cc:1428] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
W20260809 02:24:41.942943 27418 tablet.cc:2369] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:42.008528 27847 raft_consensus.cc:482] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:42.008700 27847 raft_consensus.cc:504] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:42.009724 27847 leader_election.cc:288] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 931b3ee4a068486ea1cd2afa5201ae13 (127.1.81.195:42917), 6065a3b06c5f4209bfa7a3927ff4bfd6 (127.1.81.194:41003)
I20260809 02:24:42.013602 27827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.010044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:52301 (local address 127.1.81.195:42917)
0809 02:24:42.010217 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.010222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.010362 (+ 140us) server_negotiation.cc:407] Connection header received
0809 02:24:42.010482 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.010486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.010529 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.010589 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:42.010884 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.011372 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.012539 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.012994 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.013110 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.013166 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.013411 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.013491 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 02:24:42.013612 27831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.010043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:36233 (local address 127.1.81.194:41003)
0809 02:24:42.010169 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.010174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.010315 (+ 141us) server_negotiation.cc:407] Connection header received
0809 02:24:42.010459 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.010461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.010505 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.010563 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:42.010860 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.011356 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.012544 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.012990 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.013136 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.013188 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.013414 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.013489 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:24:42.013620 27850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.009906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:41003 (local address 127.1.81.193:36233)
0809 02:24:42.010231 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.010243 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:42.010351 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:42.010581 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:42.010584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:42.010599 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:42.010754 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.010763 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.011454 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.011458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.012382 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.012393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.013148 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.013160 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.013259 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.013277 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:24:42.013388 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 02:24:42.013463 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":21,"spinlock_wait_cycles":2816,"thread_start_us":90,"threads_started":1}
I20260809 02:24:42.013628 27849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.009923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:42917 (local address 127.1.81.193:52301)
0809 02:24:42.010282 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.010293 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:42.010390 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:42.010606 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:42.010609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:42.010650 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:42.010783 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.010788 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.011490 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.011494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.012424 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.012434 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.013123 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.013126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.013233 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.013257 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:24:42.013382 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 02:24:42.013455 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":2,"spinlock_wait_cycles":2688,"thread_start_us":81,"threads_started":1}
I20260809 02:24:42.014256 27753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4b4a30df8d348359828d674dab69ac7" candidate_uuid: "39d0ebdae43b4241b80694024697a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931b3ee4a068486ea1cd2afa5201ae13" is_pre_election: true
I20260809 02:24:42.014261 27556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4b4a30df8d348359828d674dab69ac7" candidate_uuid: "39d0ebdae43b4241b80694024697a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" is_pre_election: true
I20260809 02:24:42.014500 27753 raft_consensus.cc:2454] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d0ebdae43b4241b80694024697a795 in term 0.
I20260809 02:24:42.014511 27556 raft_consensus.cc:2454] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d0ebdae43b4241b80694024697a795 in term 0.
I20260809 02:24:42.014938 27253 leader_election.cc:302] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d0ebdae43b4241b80694024697a795, 931b3ee4a068486ea1cd2afa5201ae13; no voters:
I20260809 02:24:42.015192 27847 raft_consensus.cc:2781] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:24:42.015281 27847 raft_consensus.cc:482] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:24:42.015333 27847 raft_consensus.cc:3037] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:42.016377 27847 raft_consensus.cc:504] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:42.016670 27847 leader_election.cc:288] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [CANDIDATE]: Term 1 election: Requested vote from peers 931b3ee4a068486ea1cd2afa5201ae13 (127.1.81.195:42917), 6065a3b06c5f4209bfa7a3927ff4bfd6 (127.1.81.194:41003)
I20260809 02:24:42.016995 27556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4b4a30df8d348359828d674dab69ac7" candidate_uuid: "39d0ebdae43b4241b80694024697a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6"
I20260809 02:24:42.017105 27556 raft_consensus.cc:3037] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:42.018303 27556 raft_consensus.cc:2454] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d0ebdae43b4241b80694024697a795 in term 1.
I20260809 02:24:42.018555 27753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4b4a30df8d348359828d674dab69ac7" candidate_uuid: "39d0ebdae43b4241b80694024697a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "931b3ee4a068486ea1cd2afa5201ae13"
I20260809 02:24:42.018599 27256 leader_election.cc:302] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d0ebdae43b4241b80694024697a795, 6065a3b06c5f4209bfa7a3927ff4bfd6; no voters:
I20260809 02:24:42.018692 27753 raft_consensus.cc:3037] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:42.018813 27847 raft_consensus.cc:2781] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:42.019052 27847 raft_consensus.cc:686] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [term 1 LEADER]: Becoming Leader. State: Replica: 39d0ebdae43b4241b80694024697a795, State: Running, Role: LEADER
I20260809 02:24:42.019413 27847 consensus_queue.cc:237] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } }
I20260809 02:24:42.019941 27753 raft_consensus.cc:2454] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d0ebdae43b4241b80694024697a795 in term 1.
I20260809 02:24:42.022680 27140 catalog_manager.cc:5495] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39d0ebdae43b4241b80694024697a795 (127.1.81.193). New cstate: current_term: 1 leader_uuid: "39d0ebdae43b4241b80694024697a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d0ebdae43b4241b80694024697a795" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 41997 } health_report { overall_health: HEALTHY } } }
I20260809 02:24:42.042584 27835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.039356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55350 (local address 127.1.81.193:41997)
0809 02:24:42.039462 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.039467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.039479 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:24:42.039630 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.039632 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.039690 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.039775 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:24:42.040025 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.040479 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.041312 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.041513 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.041595 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.041880 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:24:42.042239 (+ 359us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:24:42.042340 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.042412 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.042463 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:24:42.047516 27556 raft_consensus.cc:1261] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 1 FOLLOWER]: Refusing update from remote peer 39d0ebdae43b4241b80694024697a795: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:42.047515 27753 raft_consensus.cc:1261] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 1 FOLLOWER]: Refusing update from remote peer 39d0ebdae43b4241b80694024697a795: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:42.048132 27851 consensus_queue.cc:1035] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "931b3ee4a068486ea1cd2afa5201ae13" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:42.048283 27847 consensus_queue.cc:1035] T b4b4a30df8d348359828d674dab69ac7 P 39d0ebdae43b4241b80694024697a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6065a3b06c5f4209bfa7a3927ff4bfd6" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 41003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:42.056430 27857 mvcc.cc:205] Tried to move back new op lower bound from 7316448387260985344 to 7316448387155218432. Current Snapshot: MvccSnapshot[applied={T|T < 7316448387260985344}]
I20260809 02:24:42.063531 27140 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:42.063654 27140 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:42.065791 27140 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9ff3545884a4bee9d0a56bb405d8574: Sending DeleteTablet for 3 replicas of tablet b4b4a30df8d348359828d674dab69ac7
I20260809 02:24:42.066453 27524 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b4a30df8d348359828d674dab69ac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:42 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:46110
I20260809 02:24:42.066462 27722 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b4a30df8d348359828d674dab69ac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:42 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:47406
I20260809 02:24:42.066516 27323 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b4a30df8d348359828d674dab69ac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:42 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:55340
I20260809 02:24:42.066922 27874 tablet_replica.cc:330] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: stopping tablet replica
I20260809 02:24:42.067211 27874 raft_consensus.cc:2229] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:42.067338 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 27229
I20260809 02:24:42.067525 27874 raft_consensus.cc:2258] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:42.068054 27876 tablet_replica.cc:330] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: stopping tablet replica
I20260809 02:24:42.068291 27876 raft_consensus.cc:2229] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:42.068507 27876 raft_consensus.cc:2258] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:42.071465 27874 ts_tablet_manager.cc:1905] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:42.074268 27874 ts_tablet_manager.cc:1918] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:42.074376 27874 log.cc:1196] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/b4b4a30df8d348359828d674dab69ac7
I20260809 02:24:42.074747 27874 ts_tablet_manager.cc:1939] T b4b4a30df8d348359828d674dab69ac7 P 6065a3b06c5f4209bfa7a3927ff4bfd6: Deleting consensus metadata
I20260809 02:24:42.075106 27876 ts_tablet_manager.cc:1905] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:42.075923 27114 catalog_manager.cc:4841] TS 6065a3b06c5f4209bfa7a3927ff4bfd6 (127.1.81.194:41003): tablet b4b4a30df8d348359828d674dab69ac7 (table test-table [id=0d2a66de17a0474baf269df40bc6ddf1]) successfully deleted
I20260809 02:24:42.077211 27876 ts_tablet_manager.cc:1918] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:42.077289 27876 log.cc:1196] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/b4b4a30df8d348359828d674dab69ac7
I20260809 02:24:42.077497 27876 ts_tablet_manager.cc:1939] T b4b4a30df8d348359828d674dab69ac7 P 931b3ee4a068486ea1cd2afa5201ae13: Deleting consensus metadata
I20260809 02:24:42.078374 27111 catalog_manager.cc:4841] TS 931b3ee4a068486ea1cd2afa5201ae13 (127.1.81.195:42917): tablet b4b4a30df8d348359828d674dab69ac7 (table test-table [id=0d2a66de17a0474baf269df40bc6ddf1]) successfully deleted
W20260809 02:24:42.079361 27110 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:41997 (error 108)
I20260809 02:24:42.079556 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 27422
I20260809 02:24:42.084533 27826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.084222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:41997 (local address 127.0.0.1:55354)
0809 02:24:42.084369 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.084451 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:41997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 02:24:42.084703 27110 catalog_manager.cc:4584] TS 39d0ebdae43b4241b80694024697a795 (127.1.81.193:41997): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b4b4a30df8d348359828d674dab69ac7: Network error: Client connection negotiation failed: client connection to 127.1.81.193:41997: connect: Connection refused (error 111)
I20260809 02:24:42.089411 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 27634
I20260809 02:24:42.099679 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 27087
2026-08-09T02:24:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2317 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T02:24:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:42Z Disabled control of system clock
I20260809 02:24:42.134025 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43147
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:40541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:43147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:24:42.240430 27886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:42.240640 27886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:42.240684 27886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:42.244463 27886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:42.244509 27886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:42.244522 27886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:42.244541 27886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:42.244558 27886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:42.249079 27886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:43147
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:42.249938 27886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:42.251101 27886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:42.258904 27892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:42.258884 27894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:42.258864 27896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:42.259050 27886 server_base.cc:1034] running on GCE node
I20260809 02:24:42.259667 27886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:42.260640 27886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:42.261802 27886 hybrid_clock.cc:648] HybridClock initialized: now 1786242282261791 us; error 27 us; skew 500 ppm
I20260809 02:24:42.263427 27886 webserver.cc:460] Webserver started at http://127.1.81.254:45885/ using document root <none> and password file <none>
I20260809 02:24:42.264000 27886 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:42.264070 27886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:42.264266 27886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:42.266096 27886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "dfd4d3ebe5f44015b955d3e27190b9c2"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "45c261488f68cd61bd0ded9758b28105"
server_key_iv: "1d79fe9cc631a0ac23922d20a2673e39"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.266616 27886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "dfd4d3ebe5f44015b955d3e27190b9c2"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "45c261488f68cd61bd0ded9758b28105"
server_key_iv: "1d79fe9cc631a0ac23922d20a2673e39"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.269959 27886 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 02:24:42.272233 27907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.273286 27886 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:24:42.273396 27886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "dfd4d3ebe5f44015b955d3e27190b9c2"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "45c261488f68cd61bd0ded9758b28105"
server_key_iv: "1d79fe9cc631a0ac23922d20a2673e39"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.273481 27886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:42.291191 27886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:42.291754 27886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:42.291930 27886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:42.298193 27886 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:43147
I20260809 02:24:42.298203 27981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:43147 every 8 connection(s)
I20260809 02:24:42.299012 27886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:42.301800 27982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:42.306773 27982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2: Bootstrap starting.
I20260809 02:24:42.308957 27982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:42.309209 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 27886
I20260809 02:24:42.309300 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:42.309510 1351 external_mini_cluster.cc:1428] Setting key 6fe84b62a542e74b9727c7bd7298ab2f
I20260809 02:24:42.309621 27982 log.cc:824] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:42.311684 27982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2: No bootstrap required, opened a new log
I20260809 02:24:42.315378 27982 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd4d3ebe5f44015b955d3e27190b9c2" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43147 } }
I20260809 02:24:42.315634 27982 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:42.315709 27982 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfd4d3ebe5f44015b955d3e27190b9c2, State: Initialized, Role: FOLLOWER
I20260809 02:24:42.316182 27982 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd4d3ebe5f44015b955d3e27190b9c2" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43147 } }
I20260809 02:24:42.316320 27982 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:42.316386 27982 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:42.316478 27982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:42.317380 27982 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd4d3ebe5f44015b955d3e27190b9c2" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43147 } }
I20260809 02:24:42.317696 27982 leader_election.cc:302] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfd4d3ebe5f44015b955d3e27190b9c2; no voters:
I20260809 02:24:42.317824 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.310482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56180 (local address 127.1.81.254:43147)
0809 02:24:42.311009 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.311024 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.311056 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:24:42.311681 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.311698 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.312054 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.312309 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:42.312660 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.313585 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.314792 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.315228 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.315335 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.316162 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:42.316167 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:42.316179 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:42.316567 (+ 388us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:42.316633 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:42.316662 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:42.316736 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.316883 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.317119 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":99,"threads_started":1}
I20260809 02:24:42.317976 27982 leader_election.cc:288] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:42.318161 27988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:42.318365 27988 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [term 1 LEADER]: Becoming Leader. State: Replica: dfd4d3ebe5f44015b955d3e27190b9c2, State: Running, Role: LEADER
I20260809 02:24:42.318694 27988 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd4d3ebe5f44015b955d3e27190b9c2" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43147 } }
I20260809 02:24:42.319121 27982 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:42.320775 27992 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfd4d3ebe5f44015b955d3e27190b9c2. Latest consensus state: current_term: 1 leader_uuid: "dfd4d3ebe5f44015b955d3e27190b9c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd4d3ebe5f44015b955d3e27190b9c2" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43147 } } }
I20260809 02:24:42.320886 27992 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:42.321270 28005 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:42.321226 27991 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfd4d3ebe5f44015b955d3e27190b9c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd4d3ebe5f44015b955d3e27190b9c2" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43147 } } }
I20260809 02:24:42.321362 27991 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:42.324206 28005 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:42.329224 28005 catalog_manager.cc:1347] Generated new cluster ID: 27e37eb2bb8149b19f4136fb40c97c70
I20260809 02:24:42.329283 28005 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:42.341910 28005 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:42.342669 28005 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:42.349865 28005 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2: Generated new TSK 0
I20260809 02:24:42.350476 28005 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:42.360934 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43147
--builtin_ntp_servers=127.1.81.212:40541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:24:42.491882 28024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:42.492106 28024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:42.492153 28024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:42.495995 28024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:42.496037 28024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:42.496100 28024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:24:42.500702 28024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:42.501642 28024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:42.502880 28024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:24:42.511832 28024 server_base.cc:1034] running on GCE node
W20260809 02:24:42.511782 28033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:42.511822 28039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:42.512001 28036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:42.512411 28024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:42.513000 28024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:42.514153 28024 hybrid_clock.cc:648] HybridClock initialized: now 1786242282514138 us; error 26 us; skew 500 ppm
I20260809 02:24:42.515770 28024 webserver.cc:460] Webserver started at http://127.1.81.193:38271/ using document root <none> and password file <none>
I20260809 02:24:42.516425 28024 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:42.516500 28024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:42.516712 28024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:42.518661 28024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "1a0bd0446f38432eab98e935860ccb6d"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "c82bb8a62b2110da45185ca5da8965fb"
server_key_iv: "a50aaad61f28e85baba6d6fe31711479"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.519233 28024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "1a0bd0446f38432eab98e935860ccb6d"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "c82bb8a62b2110da45185ca5da8965fb"
server_key_iv: "a50aaad61f28e85baba6d6fe31711479"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.522720 28024 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 02:24:42.524916 28049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.526000 28024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:24:42.526101 28024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "1a0bd0446f38432eab98e935860ccb6d"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "c82bb8a62b2110da45185ca5da8965fb"
server_key_iv: "a50aaad61f28e85baba6d6fe31711479"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.526190 28024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:42.546161 28024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:42.546705 28024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:42.546860 28024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:42.547367 28024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:42.548277 28024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:42.548326 28024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.548374 28024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:42.548403 28024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.556496 28024 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:39695
I20260809 02:24:42.556524 28236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:39695 every 8 connection(s)
I20260809 02:24:42.557258 28024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:24:42.558234 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 28024
I20260809 02:24:42.558343 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:24:42.558599 1351 external_mini_cluster.cc:1428] Setting key e201928c010b3af06f32768ff0a34fd1
I20260809 02:24:42.560689 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43147
--builtin_ntp_servers=127.1.81.212:40541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:24:42.566681 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.558854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:54365 (local address 127.1.81.254:43147)
0809 02:24:42.558992 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.558997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.560138 (+ 1141us) server_negotiation.cc:407] Connection header received
0809 02:24:42.561815 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.561817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.561863 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.561930 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:42.562919 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.563696 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.564808 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.565165 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.565271 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.566218 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:42.566222 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:42.566225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:42.566239 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:42.566261 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:42.566272 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:42.566350 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.566461 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.566523 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:24:42.567312 28239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.559246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43147 (local address 127.1.81.193:54365)
0809 02:24:42.559979 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.560026 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:42.561611 (+ 1585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:42.562109 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:42.562117 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:42.562224 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:42.562786 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.562800 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.563818 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.563822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.564678 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.564687 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.565290 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.565292 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.565464 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.565975 (+ 511us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:42.565977 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:42.566012 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:42.566070 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:42.566347 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:42.566352 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:42.566355 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:24:42.566435 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:24:42.566627 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":122,"threads_started":1}
I20260809 02:24:42.568392 28237 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43147
I20260809 02:24:42.568596 28237 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:42.569038 28237 heartbeater.cc:511] Master 127.1.81.254:43147 requested a full tablet report, sending...
I20260809 02:24:42.570374 27927 ts_manager.cc:194] Registered new tserver with Master: 1a0bd0446f38432eab98e935860ccb6d (127.1.81.193:39695)
I20260809 02:24:42.571529 27927 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.193:54365
W20260809 02:24:42.668454 28240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:42.668678 28240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:42.668730 28240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:42.672643 28240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:42.672688 28240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:42.672757 28240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:24:42.677294 28240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:42.678128 28240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:42.679271 28240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:42.688001 28253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:42.688014 28254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:42.688014 28257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:42.688316 28240 server_base.cc:1034] running on GCE node
I20260809 02:24:42.688745 28240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:42.689280 28240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:42.690436 28240 hybrid_clock.cc:648] HybridClock initialized: now 1786242282690418 us; error 28 us; skew 500 ppm
I20260809 02:24:42.692116 28240 webserver.cc:460] Webserver started at http://127.1.81.194:44339/ using document root <none> and password file <none>
I20260809 02:24:42.692600 28240 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:42.692675 28240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:42.692864 28240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:42.694696 28240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "61a170ca03d44c4d95bba2ec89bfdd70"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "14170aab23329a58e1568a9a6cca2fac"
server_key_iv: "5c0baeb70fdbd545d77d221b4779829c"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.695199 28240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "61a170ca03d44c4d95bba2ec89bfdd70"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "14170aab23329a58e1568a9a6cca2fac"
server_key_iv: "5c0baeb70fdbd545d77d221b4779829c"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.698415 28240 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:24:42.700556 28264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.701571 28240 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:42.701684 28240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "61a170ca03d44c4d95bba2ec89bfdd70"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "14170aab23329a58e1568a9a6cca2fac"
server_key_iv: "5c0baeb70fdbd545d77d221b4779829c"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.701771 28240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:42.724920 28240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:42.725461 28240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:42.725603 28240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:42.726073 28240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:42.726872 28240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:42.726920 28240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.726955 28240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:42.726975 28240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.735133 28240 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:35189
I20260809 02:24:42.735206 28423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:35189 every 8 connection(s)
I20260809 02:24:42.735915 28240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:24:42.737396 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 28240
I20260809 02:24:42.737545 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:24:42.737854 1351 external_mini_cluster.cc:1428] Setting key 3e3d20810918b072cb7ca0b046e00586
I20260809 02:24:42.739933 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43147
--builtin_ntp_servers=127.1.81.212:40541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:24:42.744836 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.737529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:37065 (local address 127.1.81.254:43147)
0809 02:24:42.737661 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.737665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.738995 (+ 1330us) server_negotiation.cc:407] Connection header received
0809 02:24:42.740467 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.740471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.740526 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.740598 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:42.741399 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.741911 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.743000 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.743228 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.743314 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.744395 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:42.744398 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:42.744401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:42.744414 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:42.744435 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:42.744443 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:42.744501 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.744636 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.744699 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:24:42.745550 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.737970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43147 (local address 127.1.81.194:37065)
0809 02:24:42.738854 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.738903 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:42.740281 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:42.740771 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:42.740777 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:42.740853 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:42.741269 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.741280 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.742034 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.742036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.742886 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.742895 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.743368 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.743372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.743534 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.744152 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:42.744154 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:42.744201 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:42.744259 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:42.744511 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:42.744521 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:42.744526 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:24:42.744628 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:24:42.744887 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":133,"threads_started":1}
I20260809 02:24:42.746556 28424 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43147
I20260809 02:24:42.746758 28424 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:42.747197 28424 heartbeater.cc:511] Master 127.1.81.254:43147 requested a full tablet report, sending...
I20260809 02:24:42.748173 27927 ts_manager.cc:194] Registered new tserver with Master: 61a170ca03d44c4d95bba2ec89bfdd70 (127.1.81.194:35189)
I20260809 02:24:42.748905 27927 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.194:37065
W20260809 02:24:42.847900 28427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:42.848114 28427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:42.848148 28427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:42.852114 28427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:42.852159 28427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:42.852208 28427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:24:42.856695 28427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:40541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:42.857488 28427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:42.858649 28427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:42.867794 28436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:42.867786 28435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:42.867784 28439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:42.868134 28427 server_base.cc:1034] running on GCE node
I20260809 02:24:42.868561 28427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:42.869251 28427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:42.870409 28427 hybrid_clock.cc:648] HybridClock initialized: now 1786242282870385 us; error 33 us; skew 500 ppm
I20260809 02:24:42.872536 28427 webserver.cc:460] Webserver started at http://127.1.81.195:34843/ using document root <none> and password file <none>
I20260809 02:24:42.873059 28427 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:42.873121 28427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:42.873320 28427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:42.875167 28427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "9e5c5f1562994f87b970b5b778b27af6"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "cb231ffd6096bc3a20ec54db49267520"
server_key_iv: "ca3036bbe76d20490a4c578a969ac64f"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.875686 28427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "9e5c5f1562994f87b970b5b778b27af6"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "cb231ffd6096bc3a20ec54db49267520"
server_key_iv: "ca3036bbe76d20490a4c578a969ac64f"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.879127 28427 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260809 02:24:42.881306 28449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.882366 28427 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:24:42.882485 28427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "9e5c5f1562994f87b970b5b778b27af6"
format_stamp: "Formatted at 2026-08-09 02:24:42 on dist-test-slave-jlzn"
server_key: "cb231ffd6096bc3a20ec54db49267520"
server_key_iv: "ca3036bbe76d20490a4c578a969ac64f"
server_key_version: "encryptionkey@0"
I20260809 02:24:42.882575 28427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:42.898964 28427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:42.899510 28427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:42.899672 28427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:42.900207 28427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:42.901041 28427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:42.901087 28427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.901136 28427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:42.901166 28427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:42.909166 28427 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:35011
I20260809 02:24:42.909195 28630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:35011 every 8 connection(s)
I20260809 02:24:42.909917 28427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:24:42.916132 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 28427
I20260809 02:24:42.916242 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:24:42.916524 1351 external_mini_cluster.cc:1428] Setting key e10935d74abc96100ac67ef1630c5f0a
I20260809 02:24:42.918462 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.911431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:39175 (local address 127.1.81.254:43147)
0809 02:24:42.911570 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.911575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.912534 (+ 959us) server_negotiation.cc:407] Connection header received
0809 02:24:42.913826 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.913830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.913885 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.913959 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:42.914763 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.915284 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.916630 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.916894 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.917014 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.918034 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:42.918037 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:42.918039 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:42.918049 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:42.918069 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:42.918077 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:42.918133 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.918282 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.918329 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:24:42.919322 28636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.911782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43147 (local address 127.1.81.195:39175)
0809 02:24:42.912403 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.912438 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:42.913630 (+ 1192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:42.914119 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:42.914126 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:42.914204 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:42.914620 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.914632 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.915405 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.915408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.916506 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.916517 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.917059 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.917064 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.917235 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.917794 (+ 559us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:42.917796 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:42.917832 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:42.917911 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:42.918150 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:42.918159 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:42.918165 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:24:42.918290 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 02:24:42.918616 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":115,"threads_started":1}
I20260809 02:24:42.920300 28633 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43147
I20260809 02:24:42.920498 28633 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:42.920977 28633 heartbeater.cc:511] Master 127.1.81.254:43147 requested a full tablet report, sending...
I20260809 02:24:42.921878 27927 ts_manager.cc:194] Registered new tserver with Master: 9e5c5f1562994f87b970b5b778b27af6 (127.1.81.195:35011)
I20260809 02:24:42.922413 27927 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.195:39175
I20260809 02:24:42.930462 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:24:42.939116 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.935425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56196 (local address 127.1.81.254:43147)
0809 02:24:42.935541 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.935545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.935719 (+ 174us) server_negotiation.cc:407] Connection header received
0809 02:24:42.935849 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.935852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.935892 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.935956 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:42.936221 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.936840 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.937932 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.938139 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.938227 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.938801 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:42.938804 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:42.938806 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:42.938817 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:42.938834 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:42.938841 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:42.938893 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.938951 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.938994 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:24:42.941573 27927 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:24:42.944448 27927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:24:42.959714 28649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.952400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:35189 (local address 127.0.0.1:40918)
0809 02:24:42.954290 (+ 1890us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.954337 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:42.954459 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:42.955336 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:42.955341 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:42.955362 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:42.955454 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.955459 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.956867 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.956870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.958207 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.958219 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.959165 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.959169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.959284 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.959325 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 02:24:42.959444 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 02:24:42.959562 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1730,"mutex_wait_us":25,"thread_start_us":1249,"threads_started":1}
I20260809 02:24:42.959865 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.952755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:35011 (local address 127.0.0.1:53754)
0809 02:24:42.954874 (+ 2119us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.954886 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:42.954954 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:42.956360 (+ 1406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:42.956363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:42.956381 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:42.956468 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.956474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.957783 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.957787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.958669 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.958677 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.959491 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.959495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.959587 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.959609 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:24:42.959669 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 02:24:42.959729 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2066,"thread_start_us":894,"threads_started":1}
I20260809 02:24:42.959975 28655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.954940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53754 (local address 127.1.81.195:35011)
0809 02:24:42.956028 (+ 1088us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.956037 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.956054 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:24:42.956109 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.956112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.956244 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.956368 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:42.956572 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.957656 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.958786 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.959383 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.959476 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.959643 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.959708 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.959797 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":997,"thread_start_us":163,"threads_started":1}
I20260809 02:24:42.960150 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.954232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.1.81.194:35189)
0809 02:24:42.954531 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.954543 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.954568 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:24:42.954934 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.954941 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.955172 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.955326 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:42.955537 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.956755 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.958314 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.959040 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.959149 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.959339 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.959476 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.959573 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":97,"threads_started":1}
I20260809 02:24:42.960513 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.952517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:39695 (local address 127.0.0.1:40180)
0809 02:24:42.954680 (+ 2163us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:42.954693 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:42.954773 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:42.955711 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:42.955713 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:42.955726 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:42.955788 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.955791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.957087 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.957090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.958139 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:42.958149 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.960147 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.960151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:42.960237 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.960259 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:24:42.960333 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:24:42.960393 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2091,"mutex_wait_us":22,"thread_start_us":1137,"threads_started":1}
I20260809 02:24:42.961004 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:42.954261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40180 (local address 127.1.81.193:39695)
0809 02:24:42.955316 (+ 1055us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:42.955329 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:42.955352 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:24:42.955424 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:42.955428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:42.955600 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:42.955747 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:42.955921 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.956983 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.958256 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:42.959039 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:42.959158 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:42.959339 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:42.960374 (+ 1035us) server_negotiation.cc:299] Negotiation successful
0809 02:24:42.960843 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":122,"threads_started":1}
I20260809 02:24:42.962662 28524 tablet_service.cc:1467] Processing CreateTablet for tablet 6b5a5854b83041debb2d9def557f9089 (DEFAULT_TABLE table=test-table [id=33396084e9024d8b9143b6d321f8ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:42.962780 28329 tablet_service.cc:1467] Processing CreateTablet for tablet 6b5a5854b83041debb2d9def557f9089 (DEFAULT_TABLE table=test-table [id=33396084e9024d8b9143b6d321f8ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:42.963584 28524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b5a5854b83041debb2d9def557f9089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:42.963795 28329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b5a5854b83041debb2d9def557f9089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:42.963610 28124 tablet_service.cc:1467] Processing CreateTablet for tablet 6b5a5854b83041debb2d9def557f9089 (DEFAULT_TABLE table=test-table [id=33396084e9024d8b9143b6d321f8ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:42.964556 28124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b5a5854b83041debb2d9def557f9089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:42.969983 28656 tablet_bootstrap.cc:492] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: Bootstrap starting.
I20260809 02:24:42.971457 28657 tablet_bootstrap.cc:492] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Bootstrap starting.
I20260809 02:24:42.972111 28658 tablet_bootstrap.cc:492] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d: Bootstrap starting.
I20260809 02:24:42.972209 28656 tablet_bootstrap.cc:654] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:42.972903 28656 log.cc:824] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:42.973573 28657 tablet_bootstrap.cc:654] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:42.974124 28658 tablet_bootstrap.cc:654] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:42.974400 28657 log.cc:824] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:42.974700 28656 tablet_bootstrap.cc:492] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: No bootstrap required, opened a new log
I20260809 02:24:42.974882 28656 ts_tablet_manager.cc:1397] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:24:42.974923 28658 log.cc:824] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:42.976670 28657 tablet_bootstrap.cc:492] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: No bootstrap required, opened a new log
I20260809 02:24:42.976850 28657 ts_tablet_manager.cc:1397] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:24:42.976886 28658 tablet_bootstrap.cc:492] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d: No bootstrap required, opened a new log
I20260809 02:24:42.977083 28658 ts_tablet_manager.cc:1397] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:24:42.978976 28656 raft_consensus.cc:348] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:42.979234 28656 raft_consensus.cc:374] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:42.979303 28656 raft_consensus.cc:729] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e5c5f1562994f87b970b5b778b27af6, State: Initialized, Role: FOLLOWER
I20260809 02:24:42.979704 28657 raft_consensus.cc:348] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:42.979782 28656 consensus_queue.cc:260] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:42.979936 28657 raft_consensus.cc:374] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:42.980002 28657 raft_consensus.cc:729] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a170ca03d44c4d95bba2ec89bfdd70, State: Initialized, Role: FOLLOWER
I20260809 02:24:42.980456 28633 heartbeater.cc:503] Master 127.1.81.254:43147 was elected leader, sending a full tablet report...
I20260809 02:24:42.980429 28657 consensus_queue.cc:260] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:42.980786 28656 ts_tablet_manager.cc:1428] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260809 02:24:42.981118 28658 raft_consensus.cc:348] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:42.981338 28657 ts_tablet_manager.cc:1428] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 02:24:42.981352 28658 raft_consensus.cc:374] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:42.981405 28658 raft_consensus.cc:729] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0bd0446f38432eab98e935860ccb6d, State: Initialized, Role: FOLLOWER
I20260809 02:24:42.981637 28424 heartbeater.cc:503] Master 127.1.81.254:43147 was elected leader, sending a full tablet report...
I20260809 02:24:42.981791 28658 consensus_queue.cc:260] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:42.982362 28237 heartbeater.cc:503] Master 127.1.81.254:43147 was elected leader, sending a full tablet report...
I20260809 02:24:42.982661 28658 ts_tablet_manager.cc:1428] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260809 02:24:42.986738 28425 tablet.cc:2369] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:43.036906 28668 raft_consensus.cc:482] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:43.037053 28668 raft_consensus.cc:504] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:43.038055 28668 leader_election.cc:288] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61a170ca03d44c4d95bba2ec89bfdd70 (127.1.81.194:35189), 9e5c5f1562994f87b970b5b778b27af6 (127.1.81.195:35011)
I20260809 02:24:43.041415 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:43.038324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:55975 (local address 127.1.81.194:35189)
0809 02:24:43.038423 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:43.038428 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:43.038462 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:24:43.038610 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:43.038613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:43.038660 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:43.038720 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:43.038958 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.039443 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.040536 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.040917 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.041018 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:43.041068 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:43.041243 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:24:43.041307 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:24:43.041415 28239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:43.038237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:35189 (local address 127.1.81.193:55975)
0809 02:24:43.038399 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:43.038414 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:43.038516 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:43.038744 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:43.038747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:43.038763 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:43.038863 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:43.038868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.039547 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.039550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:43.040416 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:43.040426 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.041021 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.041024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:43.041121 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:43.041147 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:24:43.041214 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:24:43.041284 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":22}
I20260809 02:24:43.041555 28655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:43.038338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:44439 (local address 127.1.81.195:35011)
0809 02:24:43.038447 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:43.038451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:43.038633 (+ 182us) server_negotiation.cc:407] Connection header received
0809 02:24:43.038747 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:43.038749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:43.038788 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:43.038847 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:43.039114 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.039588 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.040677 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.041042 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.041146 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:43.041201 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:43.041370 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 02:24:43.041435 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:24:43.041586 28669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:43.038264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:35011 (local address 127.1.81.193:44439)
0809 02:24:43.038548 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:43.038558 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:43.038659 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:43.038865 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:43.038868 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:43.038884 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:43.039013 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:43.039018 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.039693 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.039697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:43.040555 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:43.040565 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.041158 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.041162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:43.041254 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:43.041277 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:24:43.041342 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:24:43.041410 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":33,"thread_start_us":58,"threads_started":1}
I20260809 02:24:43.041981 28357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b5a5854b83041debb2d9def557f9089" candidate_uuid: "1a0bd0446f38432eab98e935860ccb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" is_pre_election: true
I20260809 02:24:43.042058 28561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b5a5854b83041debb2d9def557f9089" candidate_uuid: "1a0bd0446f38432eab98e935860ccb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e5c5f1562994f87b970b5b778b27af6" is_pre_election: true
I20260809 02:24:43.042248 28357 raft_consensus.cc:2454] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0bd0446f38432eab98e935860ccb6d in term 0.
I20260809 02:24:43.042307 28561 raft_consensus.cc:2454] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0bd0446f38432eab98e935860ccb6d in term 0.
I20260809 02:24:43.042711 28052 leader_election.cc:302] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1a0bd0446f38432eab98e935860ccb6d, 61a170ca03d44c4d95bba2ec89bfdd70, 9e5c5f1562994f87b970b5b778b27af6; no voters:
I20260809 02:24:43.042954 28668 raft_consensus.cc:2781] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:24:43.043040 28668 raft_consensus.cc:482] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:24:43.043092 28668 raft_consensus.cc:3037] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:43.044041 28668 raft_consensus.cc:504] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:43.044327 28668 leader_election.cc:288] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [CANDIDATE]: Term 1 election: Requested vote from peers 61a170ca03d44c4d95bba2ec89bfdd70 (127.1.81.194:35189), 9e5c5f1562994f87b970b5b778b27af6 (127.1.81.195:35011)
I20260809 02:24:43.044646 28357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b5a5854b83041debb2d9def557f9089" candidate_uuid: "1a0bd0446f38432eab98e935860ccb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a170ca03d44c4d95bba2ec89bfdd70"
I20260809 02:24:43.044700 28561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b5a5854b83041debb2d9def557f9089" candidate_uuid: "1a0bd0446f38432eab98e935860ccb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e5c5f1562994f87b970b5b778b27af6"
I20260809 02:24:43.044771 28357 raft_consensus.cc:3037] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:43.044786 28561 raft_consensus.cc:3037] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:43.045962 28561 raft_consensus.cc:2454] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0bd0446f38432eab98e935860ccb6d in term 1.
I20260809 02:24:43.045962 28357 raft_consensus.cc:2454] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0bd0446f38432eab98e935860ccb6d in term 1.
I20260809 02:24:43.046428 28053 leader_election.cc:302] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1a0bd0446f38432eab98e935860ccb6d, 61a170ca03d44c4d95bba2ec89bfdd70, 9e5c5f1562994f87b970b5b778b27af6; no voters:
I20260809 02:24:43.046698 28668 raft_consensus.cc:2781] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:43.046913 28668 raft_consensus.cc:686] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 1 LEADER]: Becoming Leader. State: Replica: 1a0bd0446f38432eab98e935860ccb6d, State: Running, Role: LEADER
I20260809 02:24:43.047336 28668 consensus_queue.cc:237] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } }
I20260809 02:24:43.050186 27925 catalog_manager.cc:5495] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0bd0446f38432eab98e935860ccb6d (127.1.81.193). New cstate: current_term: 1 leader_uuid: "1a0bd0446f38432eab98e935860ccb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0bd0446f38432eab98e935860ccb6d" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 } health_report { overall_health: UNKNOWN } } }
W20260809 02:24:43.058274 28238 tablet.cc:2369] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:43.077214 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:43.073967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40186 (local address 127.1.81.193:39695)
0809 02:24:43.074072 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:43.074077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:43.074093 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:24:43.074261 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:43.074263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:43.074311 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:43.074394 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:24:43.074623 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.075078 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.075918 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:43.076119 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:43.076205 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:43.076480 (+ 275us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:24:43.076826 (+ 346us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:24:43.076925 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:43.077034 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 02:24:43.077083 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:24:43.082022 28561 raft_consensus.cc:1261] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 1 FOLLOWER]: Refusing update from remote peer 1a0bd0446f38432eab98e935860ccb6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:43.082022 28357 raft_consensus.cc:1261] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 1 FOLLOWER]: Refusing update from remote peer 1a0bd0446f38432eab98e935860ccb6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:43.082619 28668 consensus_queue.cc:1035] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "61a170ca03d44c4d95bba2ec89bfdd70" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:43.082790 28671 consensus_queue.cc:1035] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e5c5f1562994f87b970b5b778b27af6" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:43.092564 28675 mvcc.cc:205] Tried to move back new op lower bound from 7316448391498207232 to 7316448391364435968. Current Snapshot: MvccSnapshot[applied={T|T < 7316448391498207232}]
I20260809 02:24:43.097224 27924 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:43.097345 27924 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:43.099400 27924 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfd4d3ebe5f44015b955d3e27190b9c2: Sending DeleteTablet for 3 replicas of tablet 6b5a5854b83041debb2d9def557f9089
I20260809 02:24:43.100160 28124 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b5a5854b83041debb2d9def557f9089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:43 UTC) from {username='slave'} at 127.0.0.1:40180
I20260809 02:24:43.100147 28329 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b5a5854b83041debb2d9def557f9089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:43 UTC) from {username='slave'} at 127.0.0.1:40918
I20260809 02:24:43.100307 28524 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b5a5854b83041debb2d9def557f9089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:43 UTC) from {username='slave'} at 127.0.0.1:53754
I20260809 02:24:43.100612 28685 tablet_replica.cc:330] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: stopping tablet replica
I20260809 02:24:43.100751 28688 tablet_replica.cc:330] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: stopping tablet replica
I20260809 02:24:43.100893 28685 raft_consensus.cc:2229] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:43.100957 28688 raft_consensus.cc:2229] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:43.101148 28688 raft_consensus.cc:2258] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:43.101161 28685 raft_consensus.cc:2258] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:43.101370 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 28024
I20260809 02:24:43.101488 28686 tablet_replica.cc:330] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d: stopping tablet replica
I20260809 02:24:43.101706 28686 raft_consensus.cc:2229] T 6b5a5854b83041debb2d9def557f9089 P 1a0bd0446f38432eab98e935860ccb6d [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:24:43.104691 28685 ts_tablet_manager.cc:1905] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:43.106786 28685 ts_tablet_manager.cc:1918] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:43.106873 28685 log.cc:1196] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/6b5a5854b83041debb2d9def557f9089
I20260809 02:24:43.107213 28685 ts_tablet_manager.cc:1939] T 6b5a5854b83041debb2d9def557f9089 P 61a170ca03d44c4d95bba2ec89bfdd70: Deleting consensus metadata
I20260809 02:24:43.107770 28688 ts_tablet_manager.cc:1905] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:43.108417 27909 catalog_manager.cc:4841] TS 61a170ca03d44c4d95bba2ec89bfdd70 (127.1.81.194:35189): tablet 6b5a5854b83041debb2d9def557f9089 (table test-table [id=33396084e9024d8b9143b6d321f8ce23]) successfully deleted
I20260809 02:24:43.109946 28688 ts_tablet_manager.cc:1918] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:43.110023 28688 log.cc:1196] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/6b5a5854b83041debb2d9def557f9089
I20260809 02:24:43.110286 28688 ts_tablet_manager.cc:1939] T 6b5a5854b83041debb2d9def557f9089 P 9e5c5f1562994f87b970b5b778b27af6: Deleting consensus metadata
I20260809 02:24:43.111181 27910 catalog_manager.cc:4841] TS 9e5c5f1562994f87b970b5b778b27af6 (127.1.81.195:35011): tablet 6b5a5854b83041debb2d9def557f9089 (table test-table [id=33396084e9024d8b9143b6d321f8ce23]) successfully deleted
W20260809 02:24:43.111613 27908 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:39695 (error 108)
I20260809 02:24:43.111891 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 28240
I20260809 02:24:43.124552 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:43.124293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:39695 (local address 127.0.0.1:40200)
0809 02:24:43.124416 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:43.124483 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:39695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:24:43.124748 27908 catalog_manager.cc:4584] TS 1a0bd0446f38432eab98e935860ccb6d (127.1.81.193:39695): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6b5a5854b83041debb2d9def557f9089: Network error: Client connection negotiation failed: client connection to 127.1.81.193:39695: connect: Connection refused (error 111)
I20260809 02:24:43.129086 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 28427
I20260809 02:24:43.140898 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 27886
2026-08-09T02:24:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1042 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:43 dist-test-slave-jlzn krb5kdc[28694](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:43 dist-test-slave-jlzn krb5kdc[28694](info): set up 2 sockets
Aug 09 02:24:43 dist-test-slave-jlzn krb5kdc[28694](info): commencing operation
krb5kdc: starting...
W20260809 02:24:44.265275 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:44 dist-test-slave-jlzn krb5kdc[28694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:24:44.376210 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:37783
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:41313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:37783
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:44.481827 28711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:44.482057 28711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:44.482110 28711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:44.485981 28711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:44.486032 28711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:44.486056 28711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:44.486078 28711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:44.486102 28711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:44.491047 28711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:37783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:37783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:44.491946 28711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:44.492825 28711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:44.500571 28726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:44.500612 28724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:44.500622 28723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:44.500715 28711 server_base.cc:1034] running on GCE node
I20260809 02:24:44.501334 28711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:44.502290 28711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:44.503456 28711 hybrid_clock.cc:648] HybridClock initialized: now 1786242284503437 us; error 30 us; skew 500 ppm
Aug 09 02:24:44 dist-test-slave-jlzn krb5kdc[28694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242284, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:44.515277 28711 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:24:44.516108 28711 webserver.cc:460] Webserver started at http://127.1.81.254:39795/ using document root <none> and password file <none>
I20260809 02:24:44.516563 28711 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:44.516618 28711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:44.516786 28711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:44.518539 28711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "163f0eea2cf94629b0a3d7890dfd3df5"
format_stamp: "Formatted at 2026-08-09 02:24:44 on dist-test-slave-jlzn"
server_key: "a408345cac468123bf1f476a62e7ce30"
server_key_iv: "70b3a1375649384f58a15e584d28f491"
server_key_version: "encryptionkey@0"
I20260809 02:24:44.519022 28711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "163f0eea2cf94629b0a3d7890dfd3df5"
format_stamp: "Formatted at 2026-08-09 02:24:44 on dist-test-slave-jlzn"
server_key: "a408345cac468123bf1f476a62e7ce30"
server_key_iv: "70b3a1375649384f58a15e584d28f491"
server_key_version: "encryptionkey@0"
I20260809 02:24:44.522320 28711 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:24:44.524453 28735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:44.525503 28711 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:44.525606 28711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "163f0eea2cf94629b0a3d7890dfd3df5"
format_stamp: "Formatted at 2026-08-09 02:24:44 on dist-test-slave-jlzn"
server_key: "a408345cac468123bf1f476a62e7ce30"
server_key_iv: "70b3a1375649384f58a15e584d28f491"
server_key_version: "encryptionkey@0"
I20260809 02:24:44.525709 28711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:44.553700 28711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:44.556031 28711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:44.556208 28711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:44.562546 28711 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:37783
I20260809 02:24:44.562556 28820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:37783 every 8 connection(s)
I20260809 02:24:44.563354 28711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:44.565801 28821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:44.570724 28821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5: Bootstrap starting.
I20260809 02:24:44.571172 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 28711
I20260809 02:24:44.571306 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:44.571630 1351 external_mini_cluster.cc:1428] Setting key 8e221e76866cab0995356d4048cde41a
I20260809 02:24:44.573352 28821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:44.574007 28821 log.cc:824] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:44.576067 28821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5: No bootstrap required, opened a new log
Aug 09 02:24:44 dist-test-slave-jlzn krb5kdc[28694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:44.580044 28821 raft_consensus.cc:348] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "163f0eea2cf94629b0a3d7890dfd3df5" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37783 } }
I20260809 02:24:44.580235 28821 raft_consensus.cc:374] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:44.580297 28821 raft_consensus.cc:729] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 163f0eea2cf94629b0a3d7890dfd3df5, State: Initialized, Role: FOLLOWER
I20260809 02:24:44.580749 28821 consensus_queue.cc:260] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "163f0eea2cf94629b0a3d7890dfd3df5" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37783 } }
I20260809 02:24:44.580891 28821 raft_consensus.cc:388] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:44.580953 28821 raft_consensus.cc:482] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:44.581048 28821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:44.581946 28821 raft_consensus.cc:504] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "163f0eea2cf94629b0a3d7890dfd3df5" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37783 } }
I20260809 02:24:44.582257 28821 leader_election.cc:302] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 163f0eea2cf94629b0a3d7890dfd3df5; no voters:
I20260809 02:24:44.582515 28821 leader_election.cc:288] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:44.582633 28829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:44.582834 28829 raft_consensus.cc:686] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [term 1 LEADER]: Becoming Leader. State: Replica: 163f0eea2cf94629b0a3d7890dfd3df5, State: Running, Role: LEADER
I20260809 02:24:44.583177 28829 consensus_queue.cc:237] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "163f0eea2cf94629b0a3d7890dfd3df5" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37783 } }
I20260809 02:24:44.583727 28821 sys_catalog.cc:564] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:44.584796 28830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "163f0eea2cf94629b0a3d7890dfd3df5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "163f0eea2cf94629b0a3d7890dfd3df5" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37783 } } }
I20260809 02:24:44.584918 28830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:44.585287 28831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 163f0eea2cf94629b0a3d7890dfd3df5. Latest consensus state: current_term: 1 leader_uuid: "163f0eea2cf94629b0a3d7890dfd3df5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "163f0eea2cf94629b0a3d7890dfd3df5" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 37783 } } }
I20260809 02:24:44.585435 28831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:44.585739 28841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:44.585754 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:44.572884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57800 (local address 127.1.81.254:37783)
0809 02:24:44.573273 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:44.573286 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:44.573319 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:24:44.573927 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:44.573943 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:44.574338 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:44.574689 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:44.575438 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:44.576450 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:44.577606 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:44.578049 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:44.578161 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:44.580802 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:44.580806 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:44.580818 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:44.580844 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:44.582484 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:44.583023 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:44.583028 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:44.583034 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:44.583170 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:44.583485 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:44.583489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:44.583490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:44.584015 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:44.584222 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:44.584515 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 02:24:44.584829 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":109,"threads_started":1}
I20260809 02:24:44.589363 28841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:44.594070 28841 catalog_manager.cc:1347] Generated new cluster ID: 6b56e96fccbb42a394f5e1dadbb85609
I20260809 02:24:44.594125 28841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:44.615962 28841 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:44.617071 28841 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:44.628434 28841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5: Generated new TSK 0
I20260809 02:24:44.628999 28841 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:24:44.660702 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37783
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:41313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:44.765841 28859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:44.766048 28859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:44.766088 28859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:44.769903 28859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:44.769946 28859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:44.769999 28859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:24:44.774941 28859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:44.775733 28859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:44.776592 28859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:44.785262 28868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:44.785317 28864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:44.785317 28865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:44.785509 28859 server_base.cc:1034] running on GCE node
I20260809 02:24:44.785900 28859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:44.786438 28859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:44.787585 28859 hybrid_clock.cc:648] HybridClock initialized: now 1786242284787571 us; error 25 us; skew 500 ppm
Aug 09 02:24:44 dist-test-slave-jlzn krb5kdc[28694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242284, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:44.790099 28859 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:24:44.790853 28859 webserver.cc:460] Webserver started at http://127.1.81.193:35799/ using document root <none> and password file <none>
I20260809 02:24:44.791337 28859 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:44.791400 28859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:44.791620 28859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:44.793488 28859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "5dafad8cbd2a458d8ced75bc9813fa62"
format_stamp: "Formatted at 2026-08-09 02:24:44 on dist-test-slave-jlzn"
server_key: "4f0df4584af2e228113e402f279f91bf"
server_key_iv: "11db584da3b645520d940a3f48a1bd16"
server_key_version: "encryptionkey@0"
I20260809 02:24:44.794034 28859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "5dafad8cbd2a458d8ced75bc9813fa62"
format_stamp: "Formatted at 2026-08-09 02:24:44 on dist-test-slave-jlzn"
server_key: "4f0df4584af2e228113e402f279f91bf"
server_key_iv: "11db584da3b645520d940a3f48a1bd16"
server_key_version: "encryptionkey@0"
I20260809 02:24:44.797364 28859 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:24:44.799489 28877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:44.800566 28859 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:44.800670 28859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "5dafad8cbd2a458d8ced75bc9813fa62"
format_stamp: "Formatted at 2026-08-09 02:24:44 on dist-test-slave-jlzn"
server_key: "4f0df4584af2e228113e402f279f91bf"
server_key_iv: "11db584da3b645520d940a3f48a1bd16"
server_key_version: "encryptionkey@0"
I20260809 02:24:44.800760 28859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:44.834980 28859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:44.837453 28859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:44.837610 28859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:44.838121 28859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:44.838865 28859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:44.838923 28859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:44.838976 28859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:44.839000 28859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:44.847261 28859 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:37633
I20260809 02:24:44.847288 29052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:37633 every 8 connection(s)
I20260809 02:24:44.848059 28859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:24:44.855923 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 28859
I20260809 02:24:44.856045 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
Aug 09 02:24:44 dist-test-slave-jlzn krb5kdc[28694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242284, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:44.856370 1351 external_mini_cluster.cc:1428] Setting key 6527de7260d8c8023b146a050db5bb95
I20260809 02:24:44.860251 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:44.849598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:51357 (local address 127.1.81.254:37783)
0809 02:24:44.849722 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:44.849725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:44.850452 (+ 727us) server_negotiation.cc:407] Connection header received
0809 02:24:44.851256 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:44.851259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:44.851318 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:44.851388 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:44.852521 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:44.853045 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:44.854128 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:44.854363 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:44.854452 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:44.856838 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:44.856843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:44.856846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:44.856876 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:44.858214 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:44.858750 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:44.858752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:44.858754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:44.858823 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:44.859138 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:44.859140 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:44.859141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:44.859321 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:44.859392 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:44.859978 (+ 586us) server_negotiation.cc:299] Negotiation successful
0809 02:24:44.860098 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:24:44.860899 29055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:44.849902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37783 (local address 127.1.81.193:51357)
0809 02:24:44.850317 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:44.850356 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:44.851058 (+ 702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:44.851564 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:44.851570 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:44.851945 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:44.852373 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:44.852386 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:44.853173 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:44.853176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:44.854001 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:44.854012 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:44.854499 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:44.854503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:44.854654 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:44.855125 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:44.855148 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:44.856662 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:44.858330 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:44.858335 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:44.858347 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:44.858668 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:44.858891 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:44.858894 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:44.858895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:44.859058 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:44.859411 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:44.859417 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:44.859705 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 02:24:44.859922 (+ 217us) client_negotiation.cc:240] Negotiation successful
0809 02:24:44.860145 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":104,"threads_started":1}
I20260809 02:24:44.861955 29053 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37783
I20260809 02:24:44.862165 29053 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:44.862574 29053 heartbeater.cc:511] Master 127.1.81.254:37783 requested a full tablet report, sending...
I20260809 02:24:44.864122 28764 ts_manager.cc:194] Registered new tserver with Master: 5dafad8cbd2a458d8ced75bc9813fa62 (127.1.81.193:37633)
I20260809 02:24:44.865674 28764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:51357
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:24:44.886297 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37783
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:41313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:44.991658 29058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:44.991906 29058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:44.991959 29058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:44.995821 29058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:44.995867 29058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:44.995934 29058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:24:45.000840 29058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:45.001678 29058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:45.002570 29058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:24:45.011510 29058 server_base.cc:1034] running on GCE node
W20260809 02:24:45.011447 29064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:45.011427 29068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:45.011427 29066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:45.012195 29058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:45.012754 29058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:45.013904 29058 hybrid_clock.cc:648] HybridClock initialized: now 1786242285013891 us; error 27 us; skew 500 ppm
Aug 09 02:24:45 dist-test-slave-jlzn krb5kdc[28694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:45.016460 29058 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:24:45.017192 29058 webserver.cc:460] Webserver started at http://127.1.81.194:36651/ using document root <none> and password file <none>
I20260809 02:24:45.017648 29058 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:45.017704 29058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:45.017858 29058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:45.019637 29058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "a24fa01ab26e9a7849c9802b22429d70"
server_key_iv: "03cf22ab193cee2c586bce70743db8ae"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.020171 29058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "a24fa01ab26e9a7849c9802b22429d70"
server_key_iv: "03cf22ab193cee2c586bce70743db8ae"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.023438 29058 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:24:45.025592 29076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.026638 29058 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:45.026732 29058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "a24fa01ab26e9a7849c9802b22429d70"
server_key_iv: "03cf22ab193cee2c586bce70743db8ae"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.026808 29058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:45.058614 29058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:45.061074 29058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:45.061245 29058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:45.061748 29058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:45.062492 29058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:45.062541 29058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.062590 29058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:45.062619 29058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.070585 29058 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:39827
I20260809 02:24:45.070648 29246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:39827 every 8 connection(s)
I20260809 02:24:45.071346 29058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:24:45 dist-test-slave-jlzn krb5kdc[28694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:45.081595 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 29058
I20260809 02:24:45.081708 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:24:45.081974 1351 external_mini_cluster.cc:1428] Setting key 88658a309844b05263e3aa010868b75a
I20260809 02:24:45.082772 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.072890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:50557 (local address 127.1.81.254:37783)
0809 02:24:45.073039 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.073044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.073781 (+ 737us) server_negotiation.cc:407] Connection header received
0809 02:24:45.074527 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.074530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.074577 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.074646 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:45.075713 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.076281 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.077339 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.077541 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.077614 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.079678 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:45.079681 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:45.079683 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:45.079708 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:45.080867 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:45.081332 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:45.081336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:45.081337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:45.081415 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:45.081763 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:45.081767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:45.081768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:45.081946 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:45.082033 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.082530 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.082648 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:24:45.083595 29250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.073224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37783 (local address 127.1.81.194:50557)
0809 02:24:45.073635 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.073681 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:45.074353 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:45.074783 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:45.074788 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:45.075139 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:45.075558 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.075570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.076391 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.076393 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.077243 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.077253 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.077650 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.077653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.077780 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.078198 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:45.078213 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:45.079517 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:45.080975 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:45.080980 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:45.080993 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:45.081239 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:45.081497 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:45.081501 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:45.081503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:45.081648 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:45.082049 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:45.082055 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:45.082263 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 02:24:45.082447 (+ 184us) client_negotiation.cc:240] Negotiation successful
0809 02:24:45.082713 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":106,"threads_started":1}
I20260809 02:24:45.084611 29247 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37783
I20260809 02:24:45.084842 29247 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:45.085314 29247 heartbeater.cc:511] Master 127.1.81.254:37783 requested a full tablet report, sending...
I20260809 02:24:45.086406 28764 ts_manager.cc:194] Registered new tserver with Master: 21a45afbdf8e4c0ab7f4a3b45244ab17 (127.1.81.194:39827)
I20260809 02:24:45.087061 28764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:50557
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:24:45.107507 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37783
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:41313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:45.212873 29254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:45.213091 29254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:45.213148 29254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:45.217015 29254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:45.217065 29254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:45.217135 29254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:24:45.222045 29254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:37783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:45.222893 29254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:45.223766 29254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:24:45.232594 29254 server_base.cc:1034] running on GCE node
W20260809 02:24:45.232549 29267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:45.232568 29264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:45.232548 29263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:45.233140 29254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:45.233701 29254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:45.234853 29254 hybrid_clock.cc:648] HybridClock initialized: now 1786242285234838 us; error 25 us; skew 500 ppm
Aug 09 02:24:45 dist-test-slave-jlzn krb5kdc[28694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:45.237331 29254 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:24:45.238077 29254 webserver.cc:460] Webserver started at http://127.1.81.195:45407/ using document root <none> and password file <none>
I20260809 02:24:45.238539 29254 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:45.238600 29254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:45.238794 29254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:45.240649 29254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "a139d5a84d7e4b06ba70bca59a80a99e"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "c454be70f86f3178a177741827e90984"
server_key_iv: "e16d1bc203448f1f4a4827fe46622bd4"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.241142 29254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "a139d5a84d7e4b06ba70bca59a80a99e"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "c454be70f86f3178a177741827e90984"
server_key_iv: "e16d1bc203448f1f4a4827fe46622bd4"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.244400 29254 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:24:45.246532 29278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.247548 29254 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:24:45.247671 29254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "a139d5a84d7e4b06ba70bca59a80a99e"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "c454be70f86f3178a177741827e90984"
server_key_iv: "e16d1bc203448f1f4a4827fe46622bd4"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.247756 29254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:45.262758 29254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:45.265156 29254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:45.265311 29254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:45.265808 29254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:45.266523 29254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:45.266569 29254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.266618 29254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:45.266654 29254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.274786 29254 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:36783
I20260809 02:24:45.274853 29447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:36783 every 8 connection(s)
I20260809 02:24:45.275574 29254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:24:45.282573 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 29254
I20260809 02:24:45.282687 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:24:45.282944 1351 external_mini_cluster.cc:1428] Setting key ee7e945ad2451b528b5d5e320dc323ae
Aug 09 02:24:45 dist-test-slave-jlzn krb5kdc[28694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:45.287076 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.277212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:56163 (local address 127.1.81.254:37783)
0809 02:24:45.277331 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.277335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.278081 (+ 746us) server_negotiation.cc:407] Connection header received
0809 02:24:45.278831 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.278834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.278883 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.278951 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:45.279962 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.280474 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.281504 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.281713 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.281782 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.284050 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:45.284053 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:45.284055 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:45.284080 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:45.285456 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:45.285934 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:45.285937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:45.285939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:45.286019 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:45.286280 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:45.286282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:45.286283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:45.286437 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:45.286507 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.286876 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.286962 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:24:45.287719 29453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.277513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:37783 (local address 127.1.81.195:56163)
0809 02:24:45.277933 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.277971 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:45.278649 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:45.279082 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:45.279088 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:45.279400 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:45.279836 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.279855 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.280566 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.280568 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.281413 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.281422 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.281813 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.281816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.281947 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.282379 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:45.282395 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:45.283884 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:45.285567 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:45.285571 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:45.285581 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:45.285827 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:45.286086 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:45.286088 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:45.286089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:45.286213 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:45.286505 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:45.286509 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:45.286708 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 02:24:45.286844 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 02:24:45.287052 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":111,"threads_started":1}
I20260809 02:24:45.288661 29448 heartbeater.cc:347] Connected to a master server at 127.1.81.254:37783
I20260809 02:24:45.288851 29448 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:45.289252 29448 heartbeater.cc:511] Master 127.1.81.254:37783 requested a full tablet report, sending...
I20260809 02:24:45.290107 28764 ts_manager.cc:194] Registered new tserver with Master: a139d5a84d7e4b06ba70bca59a80a99e (127.1.81.195:36783)
I20260809 02:24:45.290620 28764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:56163
I20260809 02:24:45.296403 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:24:45.304642 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.298210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57816 (local address 127.1.81.254:37783)
0809 02:24:45.298305 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.298308 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.298486 (+ 178us) server_negotiation.cc:407] Connection header received
0809 02:24:45.298568 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.298570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.298601 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.298664 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:45.299271 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.299731 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.300508 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.300709 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.300777 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.302047 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:45.302050 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:45.302052 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:45.302071 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:45.303079 (+ 1008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:45.303477 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:45.303480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:45.303482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:45.303566 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:45.303901 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:45.303904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:45.303906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:45.304143 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:45.304261 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.304457 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.304526 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:24:45.307103 28764 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:24:45.309935 28764 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:24:45.322454 29468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.316940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37633 (local address 127.0.0.1:51102)
0809 02:24:45.317434 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.317479 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:45.317596 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:45.318371 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:45.318377 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:45.318399 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:45.318519 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.318526 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.319701 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.319705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.320812 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.320824 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.321829 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.321833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.321940 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.321974 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 02:24:45.322203 (+ 229us) client_negotiation.cc:240] Negotiation successful
0809 02:24:45.322322 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":43,"thread_start_us":62,"threads_started":1}
I20260809 02:24:45.322465 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.317122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51102 (local address 127.1.81.193:37633)
0809 02:24:45.317508 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.317522 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.317546 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:24:45.317817 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.317823 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.318028 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.318177 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:45.318643 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.319579 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.320949 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.321720 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.321814 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.321951 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.322250 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.322340 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":92,"threads_started":1}
I20260809 02:24:45.323035 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.317092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:39827 (local address 127.0.0.1:48490)
0809 02:24:45.318109 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.318122 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:45.318215 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:45.318870 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:45.318873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:45.318890 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:45.318974 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.318980 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.320305 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.320308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.321434 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.321445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.322633 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.322636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.322748 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.322771 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:24:45.322841 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:24:45.322906 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":955,"mutex_wait_us":9,"thread_start_us":90,"threads_started":1}
I20260809 02:24:45.323446 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.317644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48490 (local address 127.1.81.194:39827)
0809 02:24:45.317999 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.318010 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.318474 (+ 464us) server_negotiation.cc:407] Connection header received
0809 02:24:45.318564 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.318569 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.318745 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.318877 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:45.319061 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.320172 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.321545 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.322336 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.322433 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.322563 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.323205 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.323302 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":83,"threads_started":1}
I20260809 02:24:45.323480 29473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.317553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:36783 (local address 127.0.0.1:40070)
0809 02:24:45.318381 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.318392 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:45.318468 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:45.319068 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:45.319072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:45.319090 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:45.319184 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.319190 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.320513 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.320517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.321792 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.321803 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.323114 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.323118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.323205 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.323229 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:24:45.323293 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:24:45.323358 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"mutex_wait_us":33,"thread_start_us":101,"threads_started":1}
I20260809 02:24:45.324322 29476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.317749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40070 (local address 127.1.81.195:36783)
0809 02:24:45.318272 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.318283 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.318553 (+ 270us) server_negotiation.cc:407] Connection header received
0809 02:24:45.318621 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.318625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.318797 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.318932 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:45.319307 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.320395 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.321927 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.322994 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.323340 (+ 346us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.323466 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.324098 (+ 632us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.324193 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":115,"threads_started":1}
I20260809 02:24:45.326047 29147 tablet_service.cc:1467] Processing CreateTablet for tablet 77d56526733c45e5af7f31f55869ead7 (DEFAULT_TABLE table=test-table [id=8f7a09c42e874581b9fa1b2f25f70e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:45.327121 29147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77d56526733c45e5af7f31f55869ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:45.326814 29350 tablet_service.cc:1467] Processing CreateTablet for tablet 77d56526733c45e5af7f31f55869ead7 (DEFAULT_TABLE table=test-table [id=8f7a09c42e874581b9fa1b2f25f70e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:45.327755 29350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77d56526733c45e5af7f31f55869ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:45.335438 29477 tablet_bootstrap.cc:492] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: Bootstrap starting.
I20260809 02:24:45.336131 29478 tablet_bootstrap.cc:492] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: Bootstrap starting.
I20260809 02:24:45.335868 28954 tablet_service.cc:1467] Processing CreateTablet for tablet 77d56526733c45e5af7f31f55869ead7 (DEFAULT_TABLE table=test-table [id=8f7a09c42e874581b9fa1b2f25f70e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:45.336681 28954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77d56526733c45e5af7f31f55869ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:45.338017 29477 tablet_bootstrap.cc:654] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:45.338261 29478 tablet_bootstrap.cc:654] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:45.338912 29477 log.cc:824] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:45.339417 29478 log.cc:824] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:45.341243 29477 tablet_bootstrap.cc:492] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: No bootstrap required, opened a new log
I20260809 02:24:45.341243 29478 tablet_bootstrap.cc:492] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: No bootstrap required, opened a new log
I20260809 02:24:45.341431 29477 ts_tablet_manager.cc:1397] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:24:45.341431 29478 ts_tablet_manager.cc:1397] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:24:45.342240 29481 tablet_bootstrap.cc:492] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62: Bootstrap starting.
I20260809 02:24:45.344353 29481 tablet_bootstrap.cc:654] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:45.345134 29478 raft_consensus.cc:348] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.345134 29477 raft_consensus.cc:348] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.345404 29478 raft_consensus.cc:374] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:45.345404 29477 raft_consensus.cc:374] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:45.345460 29477 raft_consensus.cc:729] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a45afbdf8e4c0ab7f4a3b45244ab17, State: Initialized, Role: FOLLOWER
I20260809 02:24:45.345470 29478 raft_consensus.cc:729] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a139d5a84d7e4b06ba70bca59a80a99e, State: Initialized, Role: FOLLOWER
I20260809 02:24:45.345774 29481 log.cc:824] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:45.345942 29478 consensus_queue.cc:260] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.345942 29477 consensus_queue.cc:260] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.346896 29477 ts_tablet_manager.cc:1428] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:24:45.346896 29478 ts_tablet_manager.cc:1428] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:24:45.347229 29247 heartbeater.cc:503] Master 127.1.81.254:37783 was elected leader, sending a full tablet report...
I20260809 02:24:45.348275 29448 heartbeater.cc:503] Master 127.1.81.254:37783 was elected leader, sending a full tablet report...
I20260809 02:24:45.348873 29481 tablet_bootstrap.cc:492] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62: No bootstrap required, opened a new log
I20260809 02:24:45.349042 29481 ts_tablet_manager.cc:1397] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 02:24:45.352309 29481 raft_consensus.cc:348] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.352520 29481 raft_consensus.cc:374] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:45.352557 29481 raft_consensus.cc:729] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dafad8cbd2a458d8ced75bc9813fa62, State: Initialized, Role: FOLLOWER
I20260809 02:24:45.352918 29481 consensus_queue.cc:260] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.353538 29053 heartbeater.cc:503] Master 127.1.81.254:37783 was elected leader, sending a full tablet report...
I20260809 02:24:45.353770 29481 ts_tablet_manager.cc:1428] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:24:45.427023 29483 raft_consensus.cc:482] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:45.427232 29483 raft_consensus.cc:504] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.428349 29483 leader_election.cc:288] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dafad8cbd2a458d8ced75bc9813fa62 (127.1.81.193:37633), 21a45afbdf8e4c0ab7f4a3b45244ab17 (127.1.81.194:39827)
I20260809 02:24:45.432758 29453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.428566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37633 (local address 127.1.81.195:34669)
0809 02:24:45.428742 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.428756 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:45.428852 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:45.429214 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:45.429217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:45.429237 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:45.429351 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.429357 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.430385 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.430388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.431556 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.431563 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.432344 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.432347 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.432456 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.432476 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:24:45.432543 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:24:45.432619 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":5}
I20260809 02:24:45.432757 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.428631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:34669 (local address 127.1.81.193:37633)
0809 02:24:45.428750 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.428755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.428938 (+ 183us) server_negotiation.cc:407] Connection header received
0809 02:24:45.428992 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.428995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.429042 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.429101 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:45.429475 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.430250 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.431717 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.432232 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.432344 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.432399 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.432569 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.432641 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:24:45.433086 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.429051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:49823 (local address 127.1.81.194:39827)
0809 02:24:45.429192 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.429195 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.429206 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:24:45.429247 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.429249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.429285 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.429347 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:45.429621 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.430112 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.431681 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.432376 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.432464 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.432513 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.432869 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.432954 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 02:24:45.433454 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.428593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:39827 (local address 127.1.81.195:49823)
0809 02:24:45.428945 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.428958 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:45.429062 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:45.429375 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:45.429378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:45.429395 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:45.429525 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.429532 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.430217 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.430221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.431549 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.431561 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.432611 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.432615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.432730 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.432755 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:24:45.433230 (+ 475us) client_negotiation.cc:240] Negotiation successful
0809 02:24:45.433311 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":23,"thread_start_us":128,"threads_started":1}
I20260809 02:24:45.433795 28981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77d56526733c45e5af7f31f55869ead7" candidate_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" is_pre_election: true
I20260809 02:24:45.434100 28981 raft_consensus.cc:2454] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a139d5a84d7e4b06ba70bca59a80a99e in term 0.
I20260809 02:24:45.434122 29178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77d56526733c45e5af7f31f55869ead7" candidate_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" is_pre_election: true
I20260809 02:24:45.434370 29178 raft_consensus.cc:2454] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a139d5a84d7e4b06ba70bca59a80a99e in term 0.
I20260809 02:24:45.434631 29284 leader_election.cc:302] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dafad8cbd2a458d8ced75bc9813fa62, a139d5a84d7e4b06ba70bca59a80a99e; no voters:
I20260809 02:24:45.435012 29483 raft_consensus.cc:2781] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:24:45.435079 29483 raft_consensus.cc:482] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:24:45.435107 29483 raft_consensus.cc:3037] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:45.436132 29483 raft_consensus.cc:504] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.436751 28981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77d56526733c45e5af7f31f55869ead7" candidate_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dafad8cbd2a458d8ced75bc9813fa62"
I20260809 02:24:45.436753 29178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77d56526733c45e5af7f31f55869ead7" candidate_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17"
I20260809 02:24:45.436864 28981 raft_consensus.cc:3037] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:45.436864 29178 raft_consensus.cc:3037] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:45.438062 28981 raft_consensus.cc:2454] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a139d5a84d7e4b06ba70bca59a80a99e in term 1.
I20260809 02:24:45.438062 29178 raft_consensus.cc:2454] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a139d5a84d7e4b06ba70bca59a80a99e in term 1.
I20260809 02:24:45.438361 29483 leader_election.cc:288] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [CANDIDATE]: Term 1 election: Requested vote from peers 5dafad8cbd2a458d8ced75bc9813fa62 (127.1.81.193:37633), 21a45afbdf8e4c0ab7f4a3b45244ab17 (127.1.81.194:39827)
I20260809 02:24:45.438381 29285 leader_election.cc:302] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a45afbdf8e4c0ab7f4a3b45244ab17, a139d5a84d7e4b06ba70bca59a80a99e; no voters:
I20260809 02:24:45.438542 29483 raft_consensus.cc:2781] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:45.438702 29483 raft_consensus.cc:686] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 1 LEADER]: Becoming Leader. State: Replica: a139d5a84d7e4b06ba70bca59a80a99e, State: Running, Role: LEADER
I20260809 02:24:45.438968 29483 consensus_queue.cc:237] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } }
I20260809 02:24:45.441718 28764 catalog_manager.cc:5495] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e reported cstate change: term changed from 0 to 1, leader changed from <none> to a139d5a84d7e4b06ba70bca59a80a99e (127.1.81.195). New cstate: current_term: 1 leader_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a139d5a84d7e4b06ba70bca59a80a99e" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 36783 } health_report { overall_health: HEALTHY } } }
I20260809 02:24:45.473347 29476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.470324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40082 (local address 127.1.81.195:36783)
0809 02:24:45.470432 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.470436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.470448 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:24:45.470578 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.470580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.470628 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.470710 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:24:45.470896 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.471358 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.472172 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.472374 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.472444 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.472691 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:24:45.473039 (+ 348us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:24:45.473138 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.473205 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.473235 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:24:45.478638 29178 raft_consensus.cc:1261] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 1 FOLLOWER]: Refusing update from remote peer a139d5a84d7e4b06ba70bca59a80a99e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:45.478637 28981 raft_consensus.cc:1261] T 77d56526733c45e5af7f31f55869ead7 P 5dafad8cbd2a458d8ced75bc9813fa62 [term 1 FOLLOWER]: Refusing update from remote peer a139d5a84d7e4b06ba70bca59a80a99e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:45.479274 29483 consensus_queue.cc:1035] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a45afbdf8e4c0ab7f4a3b45244ab17" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:45.479445 29491 consensus_queue.cc:1035] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dafad8cbd2a458d8ced75bc9813fa62" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:45.485312 29495 mvcc.cc:205] Tried to move back new op lower bound from 7316448401314181120 to 7316448401160269824. Current Snapshot: MvccSnapshot[applied={T|T < 7316448401314181120}]
I20260809 02:24:45.493112 28758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:45.493252 28758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:45.495416 28758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 163f0eea2cf94629b0a3d7890dfd3df5: Sending DeleteTablet for 3 replicas of tablet 77d56526733c45e5af7f31f55869ead7
I20260809 02:24:45.496110 29147 tablet_service.cc:1514] Processing DeleteTablet for tablet 77d56526733c45e5af7f31f55869ead7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:45 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:48490
I20260809 02:24:45.496106 28954 tablet_service.cc:1514] Processing DeleteTablet for tablet 77d56526733c45e5af7f31f55869ead7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:45 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:51102
I20260809 02:24:45.496578 29505 tablet_replica.cc:330] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: stopping tablet replica
I20260809 02:24:45.496589 29350 tablet_service.cc:1514] Processing DeleteTablet for tablet 77d56526733c45e5af7f31f55869ead7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:45 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:40070
I20260809 02:24:45.496662 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 28859
I20260809 02:24:45.503904 29505 raft_consensus.cc:2229] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:45.504276 29505 raft_consensus.cc:2258] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:45.505631 29509 tablet_replica.cc:330] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: stopping tablet replica
I20260809 02:24:45.505914 29509 raft_consensus.cc:2229] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:24:45.506348 29509 raft_consensus.cc:2258] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:45.506644 29505 ts_tablet_manager.cc:1905] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:45.507995 29509 ts_tablet_manager.cc:1905] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:45.509536 29505 ts_tablet_manager.cc:1918] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:45.509703 29505 log.cc:1196] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/77d56526733c45e5af7f31f55869ead7
I20260809 02:24:45.510082 29505 ts_tablet_manager.cc:1939] T 77d56526733c45e5af7f31f55869ead7 P 21a45afbdf8e4c0ab7f4a3b45244ab17: Deleting consensus metadata
I20260809 02:24:45.510753 29509 ts_tablet_manager.cc:1918] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:45.510844 29509 log.cc:1196] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/77d56526733c45e5af7f31f55869ead7
I20260809 02:24:45.511116 29509 ts_tablet_manager.cc:1939] T 77d56526733c45e5af7f31f55869ead7 P a139d5a84d7e4b06ba70bca59a80a99e: Deleting consensus metadata
I20260809 02:24:45.511479 28739 catalog_manager.cc:4841] TS 21a45afbdf8e4c0ab7f4a3b45244ab17 (127.1.81.194:39827): tablet 77d56526733c45e5af7f31f55869ead7 (table test-table [id=8f7a09c42e874581b9fa1b2f25f70e33]) successfully deleted
I20260809 02:24:45.512115 28738 catalog_manager.cc:4841] TS a139d5a84d7e4b06ba70bca59a80a99e (127.1.81.195:36783): tablet 77d56526733c45e5af7f31f55869ead7 (table test-table [id=8f7a09c42e874581b9fa1b2f25f70e33]) successfully deleted
W20260809 02:24:45.516065 28738 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:37633 (error 108)
I20260809 02:24:45.516830 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 29058
I20260809 02:24:45.517024 29473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.516748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:37633 (local address 127.0.0.1:51116)
0809 02:24:45.516876 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.516946 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:24:45.545614 28738 catalog_manager.cc:4584] TS 5dafad8cbd2a458d8ced75bc9813fa62 (127.1.81.193:37633): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77d56526733c45e5af7f31f55869ead7: Network error: Client connection negotiation failed: client connection to 127.1.81.193:37633: connect: Connection refused (error 111)
I20260809 02:24:45.550777 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 29254
I20260809 02:24:45.559130 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 28711
2026-08-09T02:24:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2414 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T02:24:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:45Z Disabled control of system clock
I20260809 02:24:45.591519 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:36221
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:41757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:36221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:24:45.696617 29517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:45.696836 29517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:45.696869 29517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:45.700703 29517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:45.700749 29517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:45.700764 29517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:45.700781 29517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:45.700810 29517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:45.705284 29517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:36221
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:36221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:45.706167 29517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:45.707324 29517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:45.714924 29524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:45.714946 29525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:45.714998 29517 server_base.cc:1034] running on GCE node
W20260809 02:24:45.714946 29528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:45.715693 29517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:45.716691 29517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:45.717849 29517 hybrid_clock.cc:648] HybridClock initialized: now 1786242285717825 us; error 36 us; skew 500 ppm
I20260809 02:24:45.719437 29517 webserver.cc:460] Webserver started at http://127.1.81.254:39367/ using document root <none> and password file <none>
I20260809 02:24:45.720114 29517 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:45.720197 29517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:45.720388 29517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:45.722213 29517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "4bd49dba428244f499cab789d8bc7497"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "deddd4ef5f434c2d1d0819b5df246d6e"
server_key_iv: "7d7e1ac6a53e5a4c2c59c792bd416ff5"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.722724 29517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "4bd49dba428244f499cab789d8bc7497"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "deddd4ef5f434c2d1d0819b5df246d6e"
server_key_iv: "7d7e1ac6a53e5a4c2c59c792bd416ff5"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.726006 29517 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:24:45.728205 29538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.729259 29517 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:45.729372 29517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "4bd49dba428244f499cab789d8bc7497"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "deddd4ef5f434c2d1d0819b5df246d6e"
server_key_iv: "7d7e1ac6a53e5a4c2c59c792bd416ff5"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.729462 29517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:45.744771 29517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:45.745321 29517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:45.745474 29517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:45.751796 29517 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:36221
I20260809 02:24:45.751837 29615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:36221 every 8 connection(s)
I20260809 02:24:45.752610 29517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:45.755359 29616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:45.756815 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 29517
I20260809 02:24:45.756932 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:45.757207 1351 external_mini_cluster.cc:1428] Setting key f4f7fec5756966073722339ff50e4744
I20260809 02:24:45.761754 29616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497: Bootstrap starting.
I20260809 02:24:45.764174 29616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:45.764916 29616 log.cc:824] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:45.766842 29624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.758481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35974 (local address 127.1.81.254:36221)
0809 02:24:45.759129 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.759160 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.759203 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:24:45.759934 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.759957 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.760433 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.760778 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:45.761212 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.762604 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.763464 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.764153 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.764326 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.765025 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:45.765031 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:45.765046 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:45.765463 (+ 417us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:45.765516 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:45.765536 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:45.765624 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.765768 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.766012 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":101,"threads_started":1}
I20260809 02:24:45.766953 29616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497: No bootstrap required, opened a new log
I20260809 02:24:45.770539 29616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd49dba428244f499cab789d8bc7497" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36221 } }
I20260809 02:24:45.770747 29616 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:45.770797 29616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bd49dba428244f499cab789d8bc7497, State: Initialized, Role: FOLLOWER
I20260809 02:24:45.771127 29616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd49dba428244f499cab789d8bc7497" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36221 } }
I20260809 02:24:45.771235 29616 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:45.771278 29616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:45.771344 29616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:45.772166 29616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd49dba428244f499cab789d8bc7497" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36221 } }
I20260809 02:24:45.772444 29616 leader_election.cc:302] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bd49dba428244f499cab789d8bc7497; no voters:
I20260809 02:24:45.772679 29616 leader_election.cc:288] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:45.772799 29628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:45.773023 29628 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [term 1 LEADER]: Becoming Leader. State: Replica: 4bd49dba428244f499cab789d8bc7497, State: Running, Role: LEADER
I20260809 02:24:45.773301 29628 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd49dba428244f499cab789d8bc7497" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36221 } }
I20260809 02:24:45.773751 29616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:45.774705 29629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bd49dba428244f499cab789d8bc7497" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd49dba428244f499cab789d8bc7497" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36221 } } }
I20260809 02:24:45.774842 29629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:45.775014 29631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bd49dba428244f499cab789d8bc7497. Latest consensus state: current_term: 1 leader_uuid: "4bd49dba428244f499cab789d8bc7497" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd49dba428244f499cab789d8bc7497" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 36221 } } }
I20260809 02:24:45.775110 29631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:45.775554 29643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:45.778133 29643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:45.782902 29643 catalog_manager.cc:1347] Generated new cluster ID: 1eae9caba549451795660ab7a23f95bb
I20260809 02:24:45.782961 29643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:45.803253 29643 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:45.804126 29643 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:45.812265 29643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497: Generated new TSK 0
I20260809 02:24:45.812821 29643 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:45.815251 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36221
--builtin_ntp_servers=127.1.81.212:41757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:24:45.922390 29658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:45.922608 29658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:45.922646 29658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:45.926514 29658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:45.926561 29658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:45.926625 29658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:24:45.931161 29658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:45.932129 29658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:45.933503 29658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:45.942287 29666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:45.942333 29658 server_base.cc:1034] running on GCE node
W20260809 02:24:45.942497 29667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:45.942359 29669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:45.942957 29658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:45.943521 29658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:45.944669 29658 hybrid_clock.cc:648] HybridClock initialized: now 1786242285944646 us; error 33 us; skew 500 ppm
I20260809 02:24:45.946292 29658 webserver.cc:460] Webserver started at http://127.1.81.193:40591/ using document root <none> and password file <none>
I20260809 02:24:45.946769 29658 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:45.946825 29658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:45.946979 29658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:45.948828 29658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "1d23337c638b4e168bac0091831efdb5"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "ebb4b7fcb89e99cd94eb7609068b2517"
server_key_iv: "2e68d49a93036e30a66dfe6c881e3679"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.949314 29658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "1d23337c638b4e168bac0091831efdb5"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "ebb4b7fcb89e99cd94eb7609068b2517"
server_key_iv: "2e68d49a93036e30a66dfe6c881e3679"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.952622 29658 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:24:45.954737 29678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.955777 29658 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:24:45.955906 29658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "1d23337c638b4e168bac0091831efdb5"
format_stamp: "Formatted at 2026-08-09 02:24:45 on dist-test-slave-jlzn"
server_key: "ebb4b7fcb89e99cd94eb7609068b2517"
server_key_iv: "2e68d49a93036e30a66dfe6c881e3679"
server_key_version: "encryptionkey@0"
I20260809 02:24:45.956001 29658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:45.969126 29658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:45.969653 29658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:45.969799 29658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:45.970290 29658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:45.971093 29658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:45.971148 29658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.971199 29658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:45.971226 29658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:45.979415 29658 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:39319
I20260809 02:24:45.979439 29842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:39319 every 8 connection(s)
I20260809 02:24:45.980225 29658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:24:45.981729 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 29658
I20260809 02:24:45.981853 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:24:45.982183 1351 external_mini_cluster.cc:1428] Setting key c19e9dd692b4b3e7bec15c232ca10f3d
I20260809 02:24:45.984280 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36221
--builtin_ntp_servers=127.1.81.212:41757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:24:45.989637 29624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.981814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:40239 (local address 127.1.81.254:36221)
0809 02:24:45.981954 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:45.981959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:45.982959 (+ 1000us) server_negotiation.cc:407] Connection header received
0809 02:24:45.984641 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:45.984643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:45.984695 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:45.984752 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:45.985745 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.986273 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.987790 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.988043 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.988139 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.989158 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:45.989162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:45.989164 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:45.989175 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:45.989196 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:45.989206 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:45.989277 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:45.989470 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 02:24:45.989525 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:24:45.990720 29845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:45.982144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36221 (local address 127.1.81.193:40239)
0809 02:24:45.982820 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:45.982870 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:45.984408 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:45.984921 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:45.984929 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:45.985028 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:45.985614 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.985630 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.986394 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.986399 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.987666 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:45.987679 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:45.988210 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:45.988215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:45.988365 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:45.988906 (+ 541us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:45.988908 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:45.988946 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:45.989007 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:45.989314 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:45.989325 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:45.989332 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 02:24:45.989470 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 02:24:45.989753 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":120,"threads_started":1}
I20260809 02:24:45.991849 29843 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36221
I20260809 02:24:45.992064 29843 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:45.992523 29843 heartbeater.cc:511] Master 127.1.81.254:36221 requested a full tablet report, sending...
I20260809 02:24:45.993924 29565 ts_manager.cc:194] Registered new tserver with Master: 1d23337c638b4e168bac0091831efdb5 (127.1.81.193:39319)
I20260809 02:24:45.995016 29565 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.193:40239
W20260809 02:24:46.093590 29852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:46.093814 29852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:46.093864 29852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:46.097692 29852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:46.097738 29852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:46.097810 29852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:24:46.102289 29852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:46.103138 29852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:46.104334 29852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:46.113274 29860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:46.113366 29852 server_base.cc:1034] running on GCE node
W20260809 02:24:46.113293 29859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:46.113291 29864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:46.113821 29852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:46.114346 29852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:46.115499 29852 hybrid_clock.cc:648] HybridClock initialized: now 1786242286115481 us; error 28 us; skew 500 ppm
I20260809 02:24:46.117148 29852 webserver.cc:460] Webserver started at http://127.1.81.194:41961/ using document root <none> and password file <none>
I20260809 02:24:46.117631 29852 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:46.117693 29852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:46.117878 29852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:46.119673 29852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "252182ff9e1e453ea571ae3a15680702"
format_stamp: "Formatted at 2026-08-09 02:24:46 on dist-test-slave-jlzn"
server_key: "0cee6858080ddf4abed3c444af062a5b"
server_key_iv: "9241ed5ebbbf4153ce772b7fa758f07e"
server_key_version: "encryptionkey@0"
I20260809 02:24:46.120237 29852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "252182ff9e1e453ea571ae3a15680702"
format_stamp: "Formatted at 2026-08-09 02:24:46 on dist-test-slave-jlzn"
server_key: "0cee6858080ddf4abed3c444af062a5b"
server_key_iv: "9241ed5ebbbf4153ce772b7fa758f07e"
server_key_version: "encryptionkey@0"
I20260809 02:24:46.123471 29852 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:24:46.125660 29873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:46.126718 29852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:24:46.126820 29852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "252182ff9e1e453ea571ae3a15680702"
format_stamp: "Formatted at 2026-08-09 02:24:46 on dist-test-slave-jlzn"
server_key: "0cee6858080ddf4abed3c444af062a5b"
server_key_iv: "9241ed5ebbbf4153ce772b7fa758f07e"
server_key_version: "encryptionkey@0"
I20260809 02:24:46.126906 29852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:46.141420 29852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:46.141947 29852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:46.142097 29852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:46.142590 29852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:46.143411 29852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:46.143457 29852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:46.143505 29852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:46.143532 29852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:46.151659 29852 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:35735
I20260809 02:24:46.151690 30048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:35735 every 8 connection(s)
I20260809 02:24:46.152467 29852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:24:46.161001 29624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.154059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:40189 (local address 127.1.81.254:36221)
0809 02:24:46.154195 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.154199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.155120 (+ 921us) server_negotiation.cc:407] Connection header received
0809 02:24:46.156510 (+ 1390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.156514 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.156575 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.156647 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:46.157482 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.158009 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.159174 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.159440 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.159534 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.160537 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:46.160541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:46.160543 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:46.160557 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:46.160578 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:46.160587 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:46.160646 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.160789 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.160854 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:24:46.161412 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 29852
I20260809 02:24:46.161535 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:24:46.161872 1351 external_mini_cluster.cc:1428] Setting key 26c442722227f56094f9ee6e852c0071
I20260809 02:24:46.161933 30051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.154382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36221 (local address 127.1.81.194:40189)
0809 02:24:46.154983 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:46.155019 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:46.156303 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:46.156816 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:46.156823 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:46.156899 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:46.157339 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.157352 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.158132 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.158135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.159029 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.159040 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.159588 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.159592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.159743 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.160292 (+ 549us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:46.160293 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:46.160332 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:46.160391 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:46.160658 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:46.160668 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:46.160674 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:24:46.160778 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 02:24:46.161030 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":105,"threads_started":1}
I20260809 02:24:46.163012 30049 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36221
I20260809 02:24:46.163224 30049 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:46.163760 30049 heartbeater.cc:511] Master 127.1.81.254:36221 requested a full tablet report, sending...
I20260809 02:24:46.163993 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36221
--builtin_ntp_servers=127.1.81.212:41757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:24:46.164789 29564 ts_manager.cc:194] Registered new tserver with Master: 252182ff9e1e453ea571ae3a15680702 (127.1.81.194:35735)
I20260809 02:24:46.165337 29564 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.194:40189
W20260809 02:24:46.269831 30056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:46.270043 30056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:46.270097 30056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:46.273983 30056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:46.274029 30056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:46.274096 30056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:24:46.278791 30056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:41757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:36221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:46.279619 30056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:46.280853 30056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:46.289618 30061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:46.289630 30063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:46.289726 30056 server_base.cc:1034] running on GCE node
W20260809 02:24:46.289670 30068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:46.290169 30056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:46.290714 30056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:46.291868 30056 hybrid_clock.cc:648] HybridClock initialized: now 1786242286291851 us; error 25 us; skew 500 ppm
I20260809 02:24:46.293576 30056 webserver.cc:460] Webserver started at http://127.1.81.195:44135/ using document root <none> and password file <none>
I20260809 02:24:46.294076 30056 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:46.294142 30056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:46.294340 30056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:46.296234 30056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "acaefecee35340aba4505296e54e47b0"
format_stamp: "Formatted at 2026-08-09 02:24:46 on dist-test-slave-jlzn"
server_key: "147422bcbcc4b61ae19c09a0f73e0187"
server_key_iv: "451d3791cb7e220565dff023471f57cc"
server_key_version: "encryptionkey@0"
I20260809 02:24:46.296736 30056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "acaefecee35340aba4505296e54e47b0"
format_stamp: "Formatted at 2026-08-09 02:24:46 on dist-test-slave-jlzn"
server_key: "147422bcbcc4b61ae19c09a0f73e0187"
server_key_iv: "451d3791cb7e220565dff023471f57cc"
server_key_version: "encryptionkey@0"
I20260809 02:24:46.300036 30056 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:24:46.302121 30077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:46.303159 30056 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:46.303274 30056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "acaefecee35340aba4505296e54e47b0"
format_stamp: "Formatted at 2026-08-09 02:24:46 on dist-test-slave-jlzn"
server_key: "147422bcbcc4b61ae19c09a0f73e0187"
server_key_iv: "451d3791cb7e220565dff023471f57cc"
server_key_version: "encryptionkey@0"
I20260809 02:24:46.303361 30056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:46.328205 30056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:46.328742 30056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:46.328895 30056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:46.329434 30056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:46.330309 30056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:46.330358 30056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:46.330407 30056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:46.330433 30056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:46.338622 30056 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:39747
I20260809 02:24:46.338694 30261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:39747 every 8 connection(s)
I20260809 02:24:46.339394 30056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:24:46.340184 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 30056
I20260809 02:24:46.340301 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:24:46.340579 1351 external_mini_cluster.cc:1428] Setting key 3e5e089696ee9c30cbb6238add142bad
I20260809 02:24:46.347962 29624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.341124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:45661 (local address 127.1.81.254:36221)
0809 02:24:46.341246 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.341250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.342371 (+ 1121us) server_negotiation.cc:407] Connection header received
0809 02:24:46.343739 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.343743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.343797 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.343888 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:46.344693 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.345205 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.346285 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.346505 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.346591 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.347490 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:46.347495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:46.347498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:46.347511 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:46.347529 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:46.347536 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:46.347594 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.347740 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.347822 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:24:46.348656 30265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.341571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:36221 (local address 127.1.81.195:45661)
0809 02:24:46.342245 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:46.342281 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:46.343545 (+ 1264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:46.344043 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:46.344050 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:46.344125 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:46.344554 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.344565 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.345321 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.345325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.346167 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.346177 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.346635 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.346639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.346794 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.347260 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:46.347261 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:46.347296 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:46.347352 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:46.347603 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:46.347613 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:46.347619 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:24:46.347722 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 02:24:46.347990 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":130,"threads_started":1}
I20260809 02:24:46.349596 30262 heartbeater.cc:347] Connected to a master server at 127.1.81.254:36221
I20260809 02:24:46.349798 30262 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:46.350225 30262 heartbeater.cc:511] Master 127.1.81.254:36221 requested a full tablet report, sending...
I20260809 02:24:46.351114 29564 ts_manager.cc:194] Registered new tserver with Master: acaefecee35340aba4505296e54e47b0 (127.1.81.195:39747)
I20260809 02:24:46.351671 29564 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.195:45661
I20260809 02:24:46.354166 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:24:46.359337 29624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.356187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35980 (local address 127.1.81.254:36221)
0809 02:24:46.356294 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.356297 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.356444 (+ 147us) server_negotiation.cc:407] Connection header received
0809 02:24:46.356544 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.356546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.356580 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.356634 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:46.356844 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.357311 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.358048 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.358248 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.358312 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.359004 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:46.359007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:46.359009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:46.359020 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:46.359036 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:46.359043 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:46.359130 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.359213 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.359243 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:24:46.361707 29564 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:24:46.364612 29564 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:24:46.377542 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.372112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:35735 (local address 127.0.0.1:37420)
0809 02:24:46.372319 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:46.372330 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:46.372409 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:46.373467 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:46.373473 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:46.373510 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:46.373793 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.373802 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.374769 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.374772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.376266 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.376277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.377120 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.377124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.377209 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.377238 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 02:24:46.377301 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:24:46.377401 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":290,"spinlock_wait_cycles":16640,"thread_start_us":92,"threads_started":1}
I20260809 02:24:46.377858 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.371716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52922 (local address 127.1.81.195:39747)
0809 02:24:46.373027 (+ 1311us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.373039 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.373061 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:24:46.373126 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.373131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.373305 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.373504 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:46.373923 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.375134 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.376508 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.377265 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.377379 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.377553 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.377606 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.377701 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1064,"thread_start_us":121,"threads_started":1}
I20260809 02:24:46.377935 30278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.371651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:39747 (local address 127.0.0.1:52922)
0809 02:24:46.371994 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:46.372034 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:46.372154 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:46.373467 (+ 1313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:46.373473 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:46.373509 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:46.373810 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.373818 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.375267 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.375271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.376391 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.376401 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.377386 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.377390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.377469 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.377489 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:24:46.377546 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 02:24:46.377808 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":135,"spinlock_wait_cycles":7296,"thread_start_us":75,"threads_started":1}
I20260809 02:24:46.378270 30288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.372632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41432 (local address 127.1.81.193:39319)
0809 02:24:46.373027 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.373039 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.373061 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:24:46.373128 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.373131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.373305 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.373504 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:46.373926 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.375140 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.376564 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.377313 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.377397 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.377553 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.378006 (+ 453us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.378100 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":95,"threads_started":1}
I20260809 02:24:46.378340 30287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.372442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:39319 (local address 127.0.0.1:41432)
0809 02:24:46.372698 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:46.372711 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:46.372796 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:46.373632 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:46.373634 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:46.373652 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:46.373787 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.373794 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.375284 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.375286 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.376444 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.376453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.377619 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.377623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.377708 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.377730 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:24:46.377801 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:24:46.377867 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":100,"thread_start_us":117,"threads_started":1}
I20260809 02:24:46.378599 30283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.372301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37420 (local address 127.1.81.194:35735)
0809 02:24:46.372967 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.372978 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.373002 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:24:46.373077 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.373082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.373293 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.373754 (+ 461us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:46.373896 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.374668 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.376402 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.376981 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.378122 (+ 1141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.378303 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.378357 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.378446 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":105,"threads_started":1}
I20260809 02:24:46.380942 29946 tablet_service.cc:1467] Processing CreateTablet for tablet b39f30dc03734e499092688a59193056 (DEFAULT_TABLE table=test-table [id=01b13b63b59b42f59c2e6ea8872dc653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:46.380971 29748 tablet_service.cc:1467] Processing CreateTablet for tablet b39f30dc03734e499092688a59193056 (DEFAULT_TABLE table=test-table [id=01b13b63b59b42f59c2e6ea8872dc653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:46.380957 30152 tablet_service.cc:1467] Processing CreateTablet for tablet b39f30dc03734e499092688a59193056 (DEFAULT_TABLE table=test-table [id=01b13b63b59b42f59c2e6ea8872dc653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:46.381846 29946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39f30dc03734e499092688a59193056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:46.381940 29748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39f30dc03734e499092688a59193056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:46.381940 30152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39f30dc03734e499092688a59193056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:46.388398 30289 tablet_bootstrap.cc:492] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Bootstrap starting.
I20260809 02:24:46.389114 30290 tablet_bootstrap.cc:492] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Bootstrap starting.
I20260809 02:24:46.389114 30291 tablet_bootstrap.cc:492] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5: Bootstrap starting.
I20260809 02:24:46.390375 30289 tablet_bootstrap.cc:654] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:46.391054 30289 log.cc:824] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:46.391176 30291 tablet_bootstrap.cc:654] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:46.391171 30290 tablet_bootstrap.cc:654] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:46.392032 30291 log.cc:824] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:46.392032 30290 log.cc:824] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:46.392935 30289 tablet_bootstrap.cc:492] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: No bootstrap required, opened a new log
I20260809 02:24:46.393190 30289 ts_tablet_manager.cc:1397] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260809 02:24:46.393914 30290 tablet_bootstrap.cc:492] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: No bootstrap required, opened a new log
I20260809 02:24:46.393914 30291 tablet_bootstrap.cc:492] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5: No bootstrap required, opened a new log
I20260809 02:24:46.394100 30291 ts_tablet_manager.cc:1397] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 02:24:46.394100 30290 ts_tablet_manager.cc:1397] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 02:24:46.396557 30289 raft_consensus.cc:348] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.396759 30289 raft_consensus.cc:374] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:46.396831 30289 raft_consensus.cc:729] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 252182ff9e1e453ea571ae3a15680702, State: Initialized, Role: FOLLOWER
I20260809 02:24:46.397233 30289 consensus_queue.cc:260] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.397830 30049 heartbeater.cc:503] Master 127.1.81.254:36221 was elected leader, sending a full tablet report...
I20260809 02:24:46.398149 30289 ts_tablet_manager.cc:1428] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260809 02:24:46.398126 30291 raft_consensus.cc:348] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.398126 30290 raft_consensus.cc:348] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.398363 30290 raft_consensus.cc:374] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:46.398404 30291 raft_consensus.cc:374] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:46.398453 30290 raft_consensus.cc:729] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acaefecee35340aba4505296e54e47b0, State: Initialized, Role: FOLLOWER
I20260809 02:24:46.398481 30291 raft_consensus.cc:729] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d23337c638b4e168bac0091831efdb5, State: Initialized, Role: FOLLOWER
I20260809 02:24:46.398897 30290 consensus_queue.cc:260] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.398897 30291 consensus_queue.cc:260] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.399509 29843 heartbeater.cc:503] Master 127.1.81.254:36221 was elected leader, sending a full tablet report...
I20260809 02:24:46.399823 30290 ts_tablet_manager.cc:1428] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260809 02:24:46.399842 30291 ts_tablet_manager.cc:1428] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260809 02:24:46.400133 30262 heartbeater.cc:503] Master 127.1.81.254:36221 was elected leader, sending a full tablet report...
W20260809 02:24:46.403263 30050 tablet.cc:2369] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:24:46.481274 29844 tablet.cc:2369] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:24:46.591082 30264 tablet.cc:2369] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:46.601507 30297 raft_consensus.cc:482] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:46.601704 30297 raft_consensus.cc:504] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.602787 30297 leader_election.cc:288] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acaefecee35340aba4505296e54e47b0 (127.1.81.195:39747), 252182ff9e1e453ea571ae3a15680702 (127.1.81.194:35735)
I20260809 02:24:46.607777 30301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.602983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:35735 (local address 127.1.81.193:46271)
0809 02:24:46.603324 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:46.603340 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:46.603453 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:46.603738 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:46.603741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:46.603774 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:46.603963 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.603969 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.604969 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.604972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.606525 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.606532 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.607371 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.607374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.607455 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.607477 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:24:46.607537 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 02:24:46.607593 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":110,"spinlock_wait_cycles":10624,"thread_start_us":102,"threads_started":1}
I20260809 02:24:46.607838 30283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.603106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:46271 (local address 127.1.81.194:35735)
0809 02:24:46.603229 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.603234 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.603411 (+ 177us) server_negotiation.cc:407] Connection header received
0809 02:24:46.603562 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.603565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.603622 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.603720 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:46.604070 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.604871 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.606632 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.607259 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.607384 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.607434 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.607565 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.607677 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:24:46.607970 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.603106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:49979 (local address 127.1.81.195:39747)
0809 02:24:46.603229 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.603234 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.603499 (+ 265us) server_negotiation.cc:407] Connection header received
0809 02:24:46.603606 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.603608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.603652 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.603721 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:46.604070 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.604864 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.606632 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.607264 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.607384 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.607435 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.607741 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.607848 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:24:46.607968 30302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.602983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:39747 (local address 127.1.81.193:49979)
0809 02:24:46.603424 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:46.603436 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:46.603514 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:46.603738 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:46.603741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:46.603768 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:46.603956 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.603964 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.604969 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.604972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.606510 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:46.606523 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.607504 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.607507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:46.607616 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.607642 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:24:46.607716 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:24:46.607784 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":155,"spinlock_wait_cycles":2688,"thread_start_us":67,"threads_started":1}
I20260809 02:24:46.608804 30185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39f30dc03734e499092688a59193056" candidate_uuid: "1d23337c638b4e168bac0091831efdb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acaefecee35340aba4505296e54e47b0" is_pre_election: true
I20260809 02:24:46.609045 30185 raft_consensus.cc:2454] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d23337c638b4e168bac0091831efdb5 in term 0.
I20260809 02:24:46.609485 29686 leader_election.cc:302] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d23337c638b4e168bac0091831efdb5, acaefecee35340aba4505296e54e47b0; no voters:
I20260809 02:24:46.609504 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39f30dc03734e499092688a59193056" candidate_uuid: "1d23337c638b4e168bac0091831efdb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "252182ff9e1e453ea571ae3a15680702" is_pre_election: true
I20260809 02:24:46.609745 29974 raft_consensus.cc:2454] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d23337c638b4e168bac0091831efdb5 in term 0.
I20260809 02:24:46.609742 30297 raft_consensus.cc:2781] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:24:46.609822 30297 raft_consensus.cc:482] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:24:46.609851 30297 raft_consensus.cc:3037] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:46.610944 30297 raft_consensus.cc:504] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.611274 30297 leader_election.cc:288] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [CANDIDATE]: Term 1 election: Requested vote from peers acaefecee35340aba4505296e54e47b0 (127.1.81.195:39747), 252182ff9e1e453ea571ae3a15680702 (127.1.81.194:35735)
I20260809 02:24:46.611613 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39f30dc03734e499092688a59193056" candidate_uuid: "1d23337c638b4e168bac0091831efdb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "252182ff9e1e453ea571ae3a15680702"
I20260809 02:24:46.611613 30185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39f30dc03734e499092688a59193056" candidate_uuid: "1d23337c638b4e168bac0091831efdb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acaefecee35340aba4505296e54e47b0"
I20260809 02:24:46.611734 29974 raft_consensus.cc:3037] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:46.611734 30185 raft_consensus.cc:3037] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:46.613008 30185 raft_consensus.cc:2454] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d23337c638b4e168bac0091831efdb5 in term 1.
I20260809 02:24:46.613008 29974 raft_consensus.cc:2454] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d23337c638b4e168bac0091831efdb5 in term 1.
I20260809 02:24:46.613338 29679 leader_election.cc:302] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1d23337c638b4e168bac0091831efdb5, 252182ff9e1e453ea571ae3a15680702, acaefecee35340aba4505296e54e47b0; no voters:
I20260809 02:24:46.613533 30297 raft_consensus.cc:2781] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:46.613763 30297 raft_consensus.cc:686] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [term 1 LEADER]: Becoming Leader. State: Replica: 1d23337c638b4e168bac0091831efdb5, State: Running, Role: LEADER
I20260809 02:24:46.614073 30297 consensus_queue.cc:237] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } }
I20260809 02:24:46.616997 29564 catalog_manager.cc:5495] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d23337c638b4e168bac0091831efdb5 (127.1.81.193). New cstate: current_term: 1 leader_uuid: "1d23337c638b4e168bac0091831efdb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d23337c638b4e168bac0091831efdb5" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 39319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 } health_report { overall_health: UNKNOWN } } }
I20260809 02:24:46.663636 30288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.660674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41434 (local address 127.1.81.193:39319)
0809 02:24:46.660793 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:46.660797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:46.660811 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:24:46.660912 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:46.660915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:46.660970 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:46.661050 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:24:46.661245 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.661706 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.662496 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:46.662708 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:46.662781 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:46.662997 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:24:46.663354 (+ 357us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:24:46.663452 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:46.663517 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:24:46.663544 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:24:46.668702 29974 raft_consensus.cc:1261] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 1 FOLLOWER]: Refusing update from remote peer 1d23337c638b4e168bac0091831efdb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:46.668705 30185 raft_consensus.cc:1261] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 1 FOLLOWER]: Refusing update from remote peer 1d23337c638b4e168bac0091831efdb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:46.669301 30297 consensus_queue.cc:1035] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "252182ff9e1e453ea571ae3a15680702" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 35735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:46.669461 30303 consensus_queue.cc:1035] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acaefecee35340aba4505296e54e47b0" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 39747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:46.675482 30307 mvcc.cc:205] Tried to move back new op lower bound from 7316448406189019136 to 7316448405973770240. Current Snapshot: MvccSnapshot[applied={T|T < 7316448406189019136}]
I20260809 02:24:46.678381 30308 mvcc.cc:205] Tried to move back new op lower bound from 7316448406189019136 to 7316448405973770240. Current Snapshot: MvccSnapshot[applied={T|T < 7316448406189019136}]
I20260809 02:24:46.678400 30309 mvcc.cc:205] Tried to move back new op lower bound from 7316448406189019136 to 7316448405973770240. Current Snapshot: MvccSnapshot[applied={T|T < 7316448406189019136}]
I20260809 02:24:46.683244 29564 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:46.683368 29564 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:46.685535 29564 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4bd49dba428244f499cab789d8bc7497: Sending DeleteTablet for 3 replicas of tablet b39f30dc03734e499092688a59193056
I20260809 02:24:46.686223 30152 tablet_service.cc:1514] Processing DeleteTablet for tablet b39f30dc03734e499092688a59193056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:46 UTC) from {username='slave'} at 127.0.0.1:52922
I20260809 02:24:46.686318 29946 tablet_service.cc:1514] Processing DeleteTablet for tablet b39f30dc03734e499092688a59193056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:46 UTC) from {username='slave'} at 127.0.0.1:37420
I20260809 02:24:46.686647 30321 tablet_replica.cc:330] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: stopping tablet replica
I20260809 02:24:46.686913 30321 raft_consensus.cc:2229] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:46.687176 30321 raft_consensus.cc:2258] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:46.687302 29748 tablet_service.cc:1514] Processing DeleteTablet for tablet b39f30dc03734e499092688a59193056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:46 UTC) from {username='slave'} at 127.0.0.1:41432
I20260809 02:24:46.687729 30323 tablet_replica.cc:330] T b39f30dc03734e499092688a59193056 P 1d23337c638b4e168bac0091831efdb5: stopping tablet replica
I20260809 02:24:46.687749 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 29658
I20260809 02:24:46.688994 30321 ts_tablet_manager.cc:1905] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:46.692626 30321 ts_tablet_manager.cc:1918] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:46.692703 30321 log.cc:1196] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/b39f30dc03734e499092688a59193056
I20260809 02:24:46.692934 30321 ts_tablet_manager.cc:1939] T b39f30dc03734e499092688a59193056 P acaefecee35340aba4505296e54e47b0: Deleting consensus metadata
I20260809 02:24:46.693310 30322 tablet_replica.cc:330] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: stopping tablet replica
I20260809 02:24:46.693569 30322 raft_consensus.cc:2229] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:46.693848 30322 raft_consensus.cc:2258] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:46.694036 29545 catalog_manager.cc:4841] TS acaefecee35340aba4505296e54e47b0 (127.1.81.195:39747): tablet b39f30dc03734e499092688a59193056 (table test-table [id=01b13b63b59b42f59c2e6ea8872dc653]) successfully deleted
I20260809 02:24:46.695967 30322 ts_tablet_manager.cc:1905] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:46.698063 30322 ts_tablet_manager.cc:1918] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:46.698150 30322 log.cc:1196] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/b39f30dc03734e499092688a59193056
I20260809 02:24:46.698379 30322 ts_tablet_manager.cc:1939] T b39f30dc03734e499092688a59193056 P 252182ff9e1e453ea571ae3a15680702: Deleting consensus metadata
I20260809 02:24:46.699275 29540 catalog_manager.cc:4841] TS 252182ff9e1e453ea571ae3a15680702 (127.1.81.194:35735): tablet b39f30dc03734e499092688a59193056 (table test-table [id=01b13b63b59b42f59c2e6ea8872dc653]) successfully deleted
W20260809 02:24:46.702845 29542 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:39319 (error 108)
I20260809 02:24:46.703526 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 29852
I20260809 02:24:46.703720 30287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:46.703464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:39319 (local address 127.0.0.1:41444)
0809 02:24:46.703575 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:46.703648 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:39319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 02:24:46.704856 29542 catalog_manager.cc:4584] TS 1d23337c638b4e168bac0091831efdb5 (127.1.81.193:39319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b39f30dc03734e499092688a59193056: Network error: Client connection negotiation failed: client connection to 127.1.81.193:39319: connect: Connection refused (error 111)
I20260809 02:24:46.712601 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 30056
I20260809 02:24:46.722811 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 29517
2026-08-09T02:24:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1161 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:46 dist-test-slave-jlzn krb5kdc[30331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:46 dist-test-slave-jlzn krb5kdc[30331](info): set up 2 sockets
Aug 09 02:24:46 dist-test-slave-jlzn krb5kdc[30331](info): commencing operation
krb5kdc: starting...
W20260809 02:24:47.834786 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:47 dist-test-slave-jlzn krb5kdc[30331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:24:47.947594 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43091
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:43091
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:48.054981 30350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:48.055210 30350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:48.055264 30350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:48.059131 30350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:48.059185 30350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:48.059211 30350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:48.059233 30350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:48.059260 30350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:48.064217 30350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:43091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:48.065074 30350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:48.065944 30350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:48.073777 30355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:48.073771 30358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:48.073772 30356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:48.074005 30350 server_base.cc:1034] running on GCE node
I20260809 02:24:48.074579 30350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:48.075493 30350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:48.076650 30350 hybrid_clock.cc:648] HybridClock initialized: now 1786242288076630 us; error 32 us; skew 500 ppm
Aug 09 02:24:48 dist-test-slave-jlzn krb5kdc[30331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:48.079133 30350 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:24:48.080031 30350 webserver.cc:460] Webserver started at http://127.1.81.254:37219/ using document root <none> and password file <none>
I20260809 02:24:48.080513 30350 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:48.080578 30350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:48.080756 30350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:48.082540 30350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "c5130dec58b446f59f914f8655d6ea67"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "2275aa17e68fb1724529e5117b22e93d"
server_key_iv: "51e38491d0e12b0d4291e9b880244f91"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.083043 30350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "c5130dec58b446f59f914f8655d6ea67"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "2275aa17e68fb1724529e5117b22e93d"
server_key_iv: "51e38491d0e12b0d4291e9b880244f91"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.086434 30350 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 02:24:48.088578 30367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.089643 30350 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:48.089749 30350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "c5130dec58b446f59f914f8655d6ea67"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "2275aa17e68fb1724529e5117b22e93d"
server_key_iv: "51e38491d0e12b0d4291e9b880244f91"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.089835 30350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:48.103024 30350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:48.105446 30350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:48.105608 30350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:48.112043 30350 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:43091
I20260809 02:24:48.112058 30448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:43091 every 8 connection(s)
I20260809 02:24:48.112867 30350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:48.115341 30449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:48.120287 30449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67: Bootstrap starting.
I20260809 02:24:48.122493 30449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:48.122551 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 30350
I20260809 02:24:48.122687 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:48.122944 1351 external_mini_cluster.cc:1428] Setting key 085f803dcca59b586f03cf3b5108c317
I20260809 02:24:48.123212 30449 log.cc:824] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:48.125177 30449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67: No bootstrap required, opened a new log
I20260809 02:24:48.128968 30449 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5130dec58b446f59f914f8655d6ea67" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43091 } }
I20260809 02:24:48.129177 30449 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:48.129292 30449 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5130dec58b446f59f914f8655d6ea67, State: Initialized, Role: FOLLOWER
I20260809 02:24:48.129751 30449 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5130dec58b446f59f914f8655d6ea67" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43091 } }
I20260809 02:24:48.129916 30449 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:48.129984 30449 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:48.130084 30449 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:48.131012 30449 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5130dec58b446f59f914f8655d6ea67" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43091 } }
Aug 09 02:24:48 dist-test-slave-jlzn krb5kdc[30331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:48.131331 30449 leader_election.cc:302] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5130dec58b446f59f914f8655d6ea67; no voters:
I20260809 02:24:48.131605 30449 leader_election.cc:288] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:48.131705 30456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:48.131943 30456 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [term 1 LEADER]: Becoming Leader. State: Replica: c5130dec58b446f59f914f8655d6ea67, State: Running, Role: LEADER
I20260809 02:24:48.132297 30456 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5130dec58b446f59f914f8655d6ea67" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43091 } }
I20260809 02:24:48.132695 30449 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:48.133504 30456 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5130dec58b446f59f914f8655d6ea67. Latest consensus state: current_term: 1 leader_uuid: "c5130dec58b446f59f914f8655d6ea67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5130dec58b446f59f914f8655d6ea67" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43091 } } }
I20260809 02:24:48.133636 30456 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:48.134034 30458 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5130dec58b446f59f914f8655d6ea67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5130dec58b446f59f914f8655d6ea67" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43091 } } }
I20260809 02:24:48.134145 30458 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:48.135114 30468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:48.137030 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.123979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60882 (local address 127.1.81.254:43091)
0809 02:24:48.124365 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:48.124379 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:48.124411 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:24:48.125000 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:48.125015 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:48.125326 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:48.125588 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:48.126453 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.127388 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.128614 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.129064 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.129201 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.131845 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:48.131852 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:48.131868 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:48.131898 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:48.133920 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.134371 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.134377 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.134383 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.134523 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.134822 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.134825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.134827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.135272 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:48.135462 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:48.136101 (+ 639us) server_negotiation.cc:299] Negotiation successful
0809 02:24:48.136333 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":125,"threads_started":1}
I20260809 02:24:48.138206 30468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:48.143114 30468 catalog_manager.cc:1347] Generated new cluster ID: 8c0411b4560f4c8ba79e17745287afcb
I20260809 02:24:48.143180 30468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:48.154116 30468 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:48.154891 30468 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:48.166267 30468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67: Generated new TSK 0
I20260809 02:24:48.166837 30468 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.81.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
Entry for principal kudu/127.1.81.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab.
I20260809 02:24:48.199888 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43091
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:48.307878 30484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:48.308105 30484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:48.308144 30484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:48.311985 30484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:48.312028 30484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:48.312084 30484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:24:48.317024 30484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.193.keytab
--principal=kudu/127.1.81.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:48.317862 30484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:48.318717 30484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:48.327939 30496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:48.328064 30484 server_base.cc:1034] running on GCE node
W20260809 02:24:48.327986 30493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:48.327967 30492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:48.328480 30484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:48.329061 30484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:48.330215 30484 hybrid_clock.cc:648] HybridClock initialized: now 1786242288330200 us; error 25 us; skew 500 ppm
Aug 09 02:24:48 dist-test-slave-jlzn krb5kdc[30331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:48.332865 30484 init.cc:377] Logged in from keytab as kudu/127.1.81.193@KRBTEST.COM (short username kudu)
I20260809 02:24:48.333662 30484 webserver.cc:460] Webserver started at http://127.1.81.193:36075/ using document root <none> and password file <none>
I20260809 02:24:48.334156 30484 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:48.334220 30484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:48.334406 30484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:48.336308 30484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "5c061012e738490ebf7336ff7b19dcbe"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "4203d4b04a148b5947402fbf04711b82"
server_key_iv: "a94a8e7efc1f639054399b2953d0afd2"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.336819 30484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "5c061012e738490ebf7336ff7b19dcbe"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "4203d4b04a148b5947402fbf04711b82"
server_key_iv: "a94a8e7efc1f639054399b2953d0afd2"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.340128 30484 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:24:48.342252 30504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.343302 30484 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:48.343405 30484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "5c061012e738490ebf7336ff7b19dcbe"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "4203d4b04a148b5947402fbf04711b82"
server_key_iv: "a94a8e7efc1f639054399b2953d0afd2"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.343492 30484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:48.360915 30484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:48.363637 30484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:48.363824 30484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:48.364329 30484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:48.365047 30484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:48.365094 30484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.365141 30484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:48.365170 30484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.373556 30484 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:34619
I20260809 02:24:48.373592 30669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:34619 every 8 connection(s)
I20260809 02:24:48.374296 30484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:24:48.375187 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 30484
I20260809 02:24:48.375290 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:24:48.375584 1351 external_mini_cluster.cc:1428] Setting key 6829fe9a603ea1736d6a05952e5b31a8
Aug 09 02:24:48 dist-test-slave-jlzn krb5kdc[30331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.193@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.81.194@KRBTEST.COM; defaulting to no policy
I20260809 02:24:48.387619 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.375972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:50113 (local address 127.1.81.254:43091)
0809 02:24:48.376118 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:48.376122 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:48.376988 (+ 866us) server_negotiation.cc:407] Connection header received
0809 02:24:48.378501 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:48.378504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:48.378546 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:48.378600 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:48.379870 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.380486 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.381636 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.381997 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.382110 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.384360 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:48.384364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:48.384367 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:48.384396 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:48.385853 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.386338 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.386342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.386343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.386432 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.386706 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.386708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.386709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.386868 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:48.386938 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:48.387402 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 02:24:48.387499 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:24:48.388473 30674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.376344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43091 (local address 127.1.81.193:50113)
0809 02:24:48.376845 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:48.376899 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:48.378277 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:48.378788 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:48.378796 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:48.379252 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:48.379710 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.379723 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.380648 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.380651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.381491 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.381500 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.382141 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.382144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.382276 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.382791 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:48.382808 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:48.384199 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:48.385960 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:48.385965 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:48.385975 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:48.386242 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:48.386504 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:48.386506 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:48.386507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:48.386640 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:48.386936 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:48.386940 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:48.387218 (+ 278us) client_negotiation.cc:769] Sending connection context
0809 02:24:48.387363 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 02:24:48.387577 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":144,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.194@KRBTEST.COM" created.
I20260809 02:24:48.389758 30670 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43091
I20260809 02:24:48.389999 30670 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:48.390502 30670 heartbeater.cc:511] Master 127.1.81.254:43091 requested a full tablet report, sending...
I20260809 02:24:48.392125 30390 ts_manager.cc:194] Registered new tserver with Master: 5c061012e738490ebf7336ff7b19dcbe (127.1.81.193:34619)
I20260809 02:24:48.393698 30390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.193@KRBTEST.COM'} at 127.1.81.193:50113
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
Entry for principal kudu/127.1.81.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab.
I20260809 02:24:48.402375 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43091
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:48.509250 30677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:48.509470 30677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:48.509509 30677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:48.513351 30677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:48.513396 30677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:48.513446 30677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:24:48.518361 30677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.194.keytab
--principal=kudu/127.1.81.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:48.519177 30677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:48.520061 30677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:24:48.528955 30677 server_base.cc:1034] running on GCE node
W20260809 02:24:48.528923 30685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:48.528916 30687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:48.528924 30689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:48.529481 30677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:48.530035 30677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:48.531188 30677 hybrid_clock.cc:648] HybridClock initialized: now 1786242288531172 us; error 25 us; skew 500 ppm
Aug 09 02:24:48 dist-test-slave-jlzn krb5kdc[30331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:48.533867 30677 init.cc:377] Logged in from keytab as kudu/127.1.81.194@KRBTEST.COM (short username kudu)
I20260809 02:24:48.534751 30677 webserver.cc:460] Webserver started at http://127.1.81.194:37287/ using document root <none> and password file <none>
I20260809 02:24:48.535238 30677 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:48.535300 30677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:48.535486 30677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:48.537441 30677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "3bf3a1f6b1744d37984937f43e34632b"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "c4d41e14aaa77c8f76d8af97c9217ec2"
server_key_iv: "62033635a434590671be8aae2a777ded"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.537964 30677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "3bf3a1f6b1744d37984937f43e34632b"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "c4d41e14aaa77c8f76d8af97c9217ec2"
server_key_iv: "62033635a434590671be8aae2a777ded"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.541347 30677 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 02:24:48.543476 30697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.544571 30677 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:48.544674 30677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "3bf3a1f6b1744d37984937f43e34632b"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "c4d41e14aaa77c8f76d8af97c9217ec2"
server_key_iv: "62033635a434590671be8aae2a777ded"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.544765 30677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:48.568876 30677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:48.571254 30677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:48.571404 30677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:48.571971 30677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:48.572718 30677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:48.572765 30677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.572805 30677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:48.572834 30677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.581069 30677 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:39853
I20260809 02:24:48.581101 30857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:39853 every 8 connection(s)
I20260809 02:24:48.581845 30677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:24:48.588097 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 30677
I20260809 02:24:48.588231 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:24:48.588506 1351 external_mini_cluster.cc:1428] Setting key eefe343e808d56a55cf285bde30b54e8
Aug 09 02:24:48 dist-test-slave-jlzn krb5kdc[30331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.194@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:48.594429 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.583352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:44993 (local address 127.1.81.254:43091)
0809 02:24:48.583505 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:48.583510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:48.584254 (+ 744us) server_negotiation.cc:407] Connection header received
0809 02:24:48.585433 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:48.585436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:48.585482 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:48.585550 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:48.586518 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.587020 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.588182 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.588433 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.588519 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.591001 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:48.591006 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:48.591009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:48.591037 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:48.592425 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.593016 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.593019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.593020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.593092 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.593431 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.593433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.593434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.593587 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:48.593664 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:48.594163 (+ 499us) server_negotiation.cc:299] Negotiation successful
0809 02:24:48.594280 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:24:48.595021 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.583686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43091 (local address 127.1.81.194:44993)
0809 02:24:48.584121 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:48.584160 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:48.585255 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:48.585687 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:48.585693 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:48.585998 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:48.586412 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.586424 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.587102 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.587104 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.588066 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.588077 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.588593 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.588598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.588776 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.589369 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:48.589388 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:48.590847 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:48.592539 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:48.592545 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:48.592558 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:48.592928 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:48.593172 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:48.593175 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:48.593177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:48.593351 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:48.593674 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:48.593679 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:48.593909 (+ 230us) client_negotiation.cc:769] Sending connection context
0809 02:24:48.594091 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 02:24:48.594314 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":140,"threads_started":1}
I20260809 02:24:48.596020 30858 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43091
I20260809 02:24:48.596258 30858 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:48.596788 30858 heartbeater.cc:511] Master 127.1.81.254:43091 requested a full tablet report, sending...
I20260809 02:24:48.597888 30390 ts_manager.cc:194] Registered new tserver with Master: 3bf3a1f6b1744d37984937f43e34632b (127.1.81.194:39853)
I20260809 02:24:48.598425 30390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.194@KRBTEST.COM'} at 127.1.81.194:44993
WARNING: no policy specified for kudu/127.1.81.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
Entry for principal kudu/127.1.81.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab.
I20260809 02:24:48.616113 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43091
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:48.721776 30863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:48.721985 30863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:48.722023 30863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:48.725881 30863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:48.725925 30863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:48.725977 30863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:24:48.730799 30863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.195.keytab
--principal=kudu/127.1.81.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:43091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:48.731590 30863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:48.732460 30863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:24:48.741407 30863 server_base.cc:1034] running on GCE node
W20260809 02:24:48.741367 30877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:48.741343 30875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:48.741361 30874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:48.741974 30863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:48.742512 30863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:48.743661 30863 hybrid_clock.cc:648] HybridClock initialized: now 1786242288743650 us; error 24 us; skew 500 ppm
Aug 09 02:24:48 dist-test-slave-jlzn krb5kdc[30331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:48.746088 30863 init.cc:377] Logged in from keytab as kudu/127.1.81.195@KRBTEST.COM (short username kudu)
I20260809 02:24:48.746912 30863 webserver.cc:460] Webserver started at http://127.1.81.195:36269/ using document root <none> and password file <none>
I20260809 02:24:48.747386 30863 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:48.747515 30863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:48.747697 30863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:48.749511 30863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "6744f20830674d5d851a0aec0ae1de70"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "5e1f43ede3a4879edfdda9baf439581e"
server_key_iv: "4c58046026f5d1a3d8a67c2cacabfba9"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.749967 30863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "6744f20830674d5d851a0aec0ae1de70"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "5e1f43ede3a4879edfdda9baf439581e"
server_key_iv: "4c58046026f5d1a3d8a67c2cacabfba9"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.753227 30863 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:24:48.755280 30887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.756349 30863 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:48.756451 30863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "6744f20830674d5d851a0aec0ae1de70"
format_stamp: "Formatted at 2026-08-09 02:24:48 on dist-test-slave-jlzn"
server_key: "5e1f43ede3a4879edfdda9baf439581e"
server_key_iv: "4c58046026f5d1a3d8a67c2cacabfba9"
server_key_version: "encryptionkey@0"
I20260809 02:24:48.756536 30863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:48.776844 30863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:48.779192 30863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:48.779341 30863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:48.779867 30863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:48.780619 30863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:48.780718 30863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.780776 30863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:48.780792 30863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:48.788906 30863 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:45445
I20260809 02:24:48.788952 31068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:45445 every 8 connection(s)
I20260809 02:24:48.789669 30863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:24:48.791005 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 30863
I20260809 02:24:48.791111 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:24:48.791417 1351 external_mini_cluster.cc:1428] Setting key 743569c7c98eadb4f5f78390de137234
Aug 09 02:24:48 dist-test-slave-jlzn krb5kdc[30331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242288, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.195@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:24:48.802085 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.791273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:36663 (local address 127.1.81.254:43091)
0809 02:24:48.791419 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:48.791424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:48.792265 (+ 841us) server_negotiation.cc:407] Connection header received
0809 02:24:48.793732 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:48.793735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:48.793781 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:48.793845 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:48.794836 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.795343 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.796448 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.796657 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.796726 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.798875 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:48.798878 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:48.798881 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:48.798905 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:48.800193 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.800656 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.800660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.800662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.800742 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.801060 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.801064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.801065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.801251 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:48.801335 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:48.801806 (+ 471us) server_negotiation.cc:299] Negotiation successful
0809 02:24:48.801929 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:24:48.802776 31073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.791615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:43091 (local address 127.1.81.195:36663)
0809 02:24:48.792122 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:48.792175 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:48.793540 (+ 1365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:48.793980 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:48.793986 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:48.794302 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:48.794731 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.794743 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.795426 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.795429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.796348 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.796358 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.796758 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.796760 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.796894 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.797338 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:24:48.797354 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:48.798721 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:48.800302 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:48.800308 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:48.800321 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:48.800563 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:48.800834 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:24:48.800838 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:24:48.800840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:24:48.800973 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:24:48.801354 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:48.801360 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:48.801576 (+ 216us) client_negotiation.cc:769] Sending connection context
0809 02:24:48.801739 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 02:24:48.802028 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":157,"threads_started":1}
I20260809 02:24:48.803725 31069 heartbeater.cc:347] Connected to a master server at 127.1.81.254:43091
I20260809 02:24:48.803953 31069 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:48.804383 31069 heartbeater.cc:511] Master 127.1.81.254:43091 requested a full tablet report, sending...
I20260809 02:24:48.805310 30390 ts_manager.cc:194] Registered new tserver with Master: 6744f20830674d5d851a0aec0ae1de70 (127.1.81.195:45445)
I20260809 02:24:48.805814 30390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.81.195@KRBTEST.COM'} at 127.1.81.195:36663
I20260809 02:24:48.816314 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:24:48.824551 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.818101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60898 (local address 127.1.81.254:43091)
0809 02:24:48.818226 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:48.818230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:48.818392 (+ 162us) server_negotiation.cc:407] Connection header received
0809 02:24:48.818511 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:48.818514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:48.818553 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:48.818615 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:48.819244 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.819726 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.820547 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.820757 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.820842 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.822012 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:48.822015 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:48.822017 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:48.822038 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:48.823007 (+ 969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.823377 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.823381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.823383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.823456 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:48.823700 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:48.823703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:48.823705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:48.823960 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:48.824080 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:48.824306 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 02:24:48.824411 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:24:48.826853 30390 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:24:48.829763 30390 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:24:48.842658 31089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.837581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47062 (local address 127.1.81.195:45445)
0809 02:24:48.838050 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:48.838063 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:48.838086 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:24:48.838152 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:48.838157 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:48.838500 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:48.838999 (+ 499us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:48.839135 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.840174 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.841387 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.842034 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.842129 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.842279 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:48.842432 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 02:24:48.842516 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":150,"threads_started":1}
I20260809 02:24:48.842658 31088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.837483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:45445 (local address 127.0.0.1:47062)
0809 02:24:48.837815 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:48.837863 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:48.837987 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:48.838693 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:48.838699 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:48.838724 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:48.838840 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.838847 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.840277 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.840280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.841254 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.841264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.842144 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.842147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.842257 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.842294 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:24:48.842395 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 02:24:48.842515 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":81,"threads_started":1}
I20260809 02:24:48.843626 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.837663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:39853 (local address 127.0.0.1:33656)
0809 02:24:48.838889 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:48.838901 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:48.838986 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:48.839710 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:48.839714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:48.839732 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:48.839844 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.839852 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.841147 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.841150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.842192 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.842202 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.843239 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.843242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.843326 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.843348 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:24:48.843427 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 02:24:48.843498 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1166,"mutex_wait_us":17,"thread_start_us":80,"threads_started":1}
I20260809 02:24:48.844501 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.838642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34619 (local address 127.0.0.1:45990)
0809 02:24:48.839140 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:48.839164 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:48.839257 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:48.840015 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:48.840018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:48.840034 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:48.840108 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.840113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.841499 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.841502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.843049 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:48.843059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.844098 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.844101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:48.844214 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.844238 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:24:48.844313 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:24:48.844380 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":3,"thread_start_us":99,"threads_started":1}
I20260809 02:24:48.844575 31094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.839055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45990 (local address 127.1.81.193:34619)
0809 02:24:48.839425 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:48.839436 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:48.839457 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:24:48.839529 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:48.839534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:48.839703 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:48.839861 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:48.840247 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.841353 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.843205 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.843986 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.844088 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.844236 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:48.844342 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 02:24:48.844437 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":152,"threads_started":1}
I20260809 02:24:48.845705 30963 tablet_service.cc:1467] Processing CreateTablet for tablet bdb97479e28b426cb94a54730d7b634a (DEFAULT_TABLE table=test-table [id=ddf833001f5d45178e8071ffe94309d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:48.846628 30963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb97479e28b426cb94a54730d7b634a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:48.847893 31091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:48.838259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33656 (local address 127.1.81.194:39853)
0809 02:24:48.838648 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:48.838668 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:48.839380 (+ 712us) server_negotiation.cc:407] Connection header received
0809 02:24:48.839452 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:48.839455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:48.839586 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:48.839719 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:48.839937 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.840998 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.842306 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:48.843110 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:48.843236 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:48.843367 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:48.843455 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 02:24:48.843534 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":97,"threads_started":1}
I20260809 02:24:48.849681 30574 tablet_service.cc:1467] Processing CreateTablet for tablet bdb97479e28b426cb94a54730d7b634a (DEFAULT_TABLE table=test-table [id=ddf833001f5d45178e8071ffe94309d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:48.850064 30761 tablet_service.cc:1467] Processing CreateTablet for tablet bdb97479e28b426cb94a54730d7b634a (DEFAULT_TABLE table=test-table [id=ddf833001f5d45178e8071ffe94309d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:48.850473 30574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb97479e28b426cb94a54730d7b634a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:48.850847 30761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb97479e28b426cb94a54730d7b634a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:48.856356 31095 tablet_bootstrap.cc:492] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Bootstrap starting.
I20260809 02:24:48.857585 31097 tablet_bootstrap.cc:492] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe: Bootstrap starting.
I20260809 02:24:48.858584 31098 tablet_bootstrap.cc:492] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Bootstrap starting.
I20260809 02:24:48.858865 31095 tablet_bootstrap.cc:654] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:48.859738 31095 log.cc:824] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:48.859791 31097 tablet_bootstrap.cc:654] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:48.860824 31098 tablet_bootstrap.cc:654] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:48.861068 31097 log.cc:824] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:48.861528 31095 tablet_bootstrap.cc:492] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: No bootstrap required, opened a new log
I20260809 02:24:48.861732 31095 ts_tablet_manager.cc:1397] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 02:24:48.862000 31098 log.cc:824] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:48.862959 31097 tablet_bootstrap.cc:492] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe: No bootstrap required, opened a new log
I20260809 02:24:48.863142 31097 ts_tablet_manager.cc:1397] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260809 02:24:48.863952 31098 tablet_bootstrap.cc:492] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: No bootstrap required, opened a new log
I20260809 02:24:48.864204 31098 ts_tablet_manager.cc:1397] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:24:48.865129 31095 raft_consensus.cc:348] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:48.865463 31095 raft_consensus.cc:374] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:48.865556 31095 raft_consensus.cc:729] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf3a1f6b1744d37984937f43e34632b, State: Initialized, Role: FOLLOWER
I20260809 02:24:48.866055 31095 consensus_queue.cc:260] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:48.867055 31095 ts_tablet_manager.cc:1428] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
I20260809 02:24:48.867450 30858 heartbeater.cc:503] Master 127.1.81.254:43091 was elected leader, sending a full tablet report...
I20260809 02:24:48.868172 31098 raft_consensus.cc:348] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:48.868501 31098 raft_consensus.cc:374] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:48.868608 31098 raft_consensus.cc:729] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6744f20830674d5d851a0aec0ae1de70, State: Initialized, Role: FOLLOWER
I20260809 02:24:48.869086 31098 consensus_queue.cc:260] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:48.870092 31098 ts_tablet_manager.cc:1428] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:24:48.870471 31069 heartbeater.cc:503] Master 127.1.81.254:43091 was elected leader, sending a full tablet report...
I20260809 02:24:48.870232 31097 raft_consensus.cc:348] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:48.870590 31097 raft_consensus.cc:374] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:48.870653 31097 raft_consensus.cc:729] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c061012e738490ebf7336ff7b19dcbe, State: Initialized, Role: FOLLOWER
I20260809 02:24:48.871034 31097 consensus_queue.cc:260] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:48.871994 31097 ts_tablet_manager.cc:1428] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260809 02:24:48.872349 30670 heartbeater.cc:503] Master 127.1.81.254:43091 was elected leader, sending a full tablet report...
W20260809 02:24:48.875275 30673 tablet.cc:2369] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:24:49.040635 31072 tablet.cc:2369] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:49.072701 31106 raft_consensus.cc:482] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:49.072903 31106 raft_consensus.cc:504] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:49.074020 31106 leader_election.cc:288] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf3a1f6b1744d37984937f43e34632b (127.1.81.194:39853), 5c061012e738490ebf7336ff7b19dcbe (127.1.81.193:34619)
I20260809 02:24:49.077672 31073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.074226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:39853 (local address 127.1.81.195:42719)
0809 02:24:49.074332 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:49.074347 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:49.074433 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:49.074719 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:49.074721 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:49.074741 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:49.074867 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:49.074875 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.075704 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.075708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:49.076587 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:49.076597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.077278 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.077282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:49.077384 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.077411 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:24:49.077478 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:24:49.077548 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:24:49.077701 31091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.074348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:42719 (local address 127.1.81.194:39853)
0809 02:24:49.074468 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:49.074472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:49.074506 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:24:49.074564 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:49.074567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:49.074619 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:49.074700 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:49.074981 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.075595 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.076714 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.077174 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.077269 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.077313 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:49.077500 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 02:24:49.077573 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:24:49.077819 31109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.074226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34619 (local address 127.1.81.195:39089)
0809 02:24:49.074686 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:49.074700 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:49.074807 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:49.075057 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:49.075060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:49.075078 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:49.075193 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:49.075199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.075955 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.075957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:49.076774 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:49.076784 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.077428 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.077431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:49.077526 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.077549 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:24:49.077621 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:24:49.077691 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":106,"thread_start_us":112,"threads_started":1}
I20260809 02:24:49.077838 31094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.074349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:39089 (local address 127.1.81.193:34619)
0809 02:24:49.074468 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:49.074472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:49.074789 (+ 317us) server_negotiation.cc:407] Connection header received
0809 02:24:49.074903 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:49.074907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:49.074964 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:49.075025 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:49.075289 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.075857 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.076896 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.077320 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.077434 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.077482 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:49.077643 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:24:49.077726 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:24:49.078397 30604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb97479e28b426cb94a54730d7b634a" candidate_uuid: "6744f20830674d5d851a0aec0ae1de70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c061012e738490ebf7336ff7b19dcbe" is_pre_election: true
I20260809 02:24:49.078593 30787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb97479e28b426cb94a54730d7b634a" candidate_uuid: "6744f20830674d5d851a0aec0ae1de70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf3a1f6b1744d37984937f43e34632b" is_pre_election: true
I20260809 02:24:49.078704 30604 raft_consensus.cc:2454] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6744f20830674d5d851a0aec0ae1de70 in term 0.
I20260809 02:24:49.078892 30787 raft_consensus.cc:2454] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6744f20830674d5d851a0aec0ae1de70 in term 0.
I20260809 02:24:49.079206 30893 leader_election.cc:302] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c061012e738490ebf7336ff7b19dcbe, 6744f20830674d5d851a0aec0ae1de70; no voters:
I20260809 02:24:49.079486 31106 raft_consensus.cc:2781] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:24:49.079564 31106 raft_consensus.cc:482] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:24:49.079594 31106 raft_consensus.cc:3037] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:49.080642 31106 raft_consensus.cc:504] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:49.080967 31106 leader_election.cc:288] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [CANDIDATE]: Term 1 election: Requested vote from peers 3bf3a1f6b1744d37984937f43e34632b (127.1.81.194:39853), 5c061012e738490ebf7336ff7b19dcbe (127.1.81.193:34619)
I20260809 02:24:49.081326 30604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb97479e28b426cb94a54730d7b634a" candidate_uuid: "6744f20830674d5d851a0aec0ae1de70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c061012e738490ebf7336ff7b19dcbe"
I20260809 02:24:49.081337 30787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb97479e28b426cb94a54730d7b634a" candidate_uuid: "6744f20830674d5d851a0aec0ae1de70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf3a1f6b1744d37984937f43e34632b"
I20260809 02:24:49.081432 30604 raft_consensus.cc:3037] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:49.081439 30787 raft_consensus.cc:3037] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:49.082468 30787 raft_consensus.cc:2454] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6744f20830674d5d851a0aec0ae1de70 in term 1.
I20260809 02:24:49.082474 30604 raft_consensus.cc:2454] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6744f20830674d5d851a0aec0ae1de70 in term 1.
I20260809 02:24:49.082785 30891 leader_election.cc:302] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf3a1f6b1744d37984937f43e34632b, 6744f20830674d5d851a0aec0ae1de70; no voters:
W20260809 02:24:49.082836 30859 tablet.cc:2369] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:49.083108 31106 raft_consensus.cc:2781] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:49.083329 31106 raft_consensus.cc:686] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 1 LEADER]: Becoming Leader. State: Replica: 6744f20830674d5d851a0aec0ae1de70, State: Running, Role: LEADER
I20260809 02:24:49.083644 31106 consensus_queue.cc:237] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } }
I20260809 02:24:49.086463 30387 catalog_manager.cc:5495] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6744f20830674d5d851a0aec0ae1de70 (127.1.81.195). New cstate: current_term: 1 leader_uuid: "6744f20830674d5d851a0aec0ae1de70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6744f20830674d5d851a0aec0ae1de70" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 45445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 } health_report { overall_health: UNKNOWN } } }
I20260809 02:24:49.128911 31089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.125854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47070 (local address 127.1.81.195:45445)
0809 02:24:49.125968 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:49.125973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:49.126057 (+ 84us) server_negotiation.cc:407] Connection header received
0809 02:24:49.126175 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:49.126177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:49.126227 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:49.126305 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:24:49.126485 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.126949 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.127699 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.127939 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.128014 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.128244 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:24:49.128591 (+ 347us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:24:49.128679 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:49.128722 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 02:24:49.128765 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:24:49.134141 30604 raft_consensus.cc:1261] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe [term 1 FOLLOWER]: Refusing update from remote peer 6744f20830674d5d851a0aec0ae1de70: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:49.134160 30787 raft_consensus.cc:1261] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 1 FOLLOWER]: Refusing update from remote peer 6744f20830674d5d851a0aec0ae1de70: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:49.134778 31110 consensus_queue.cc:1035] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c061012e738490ebf7336ff7b19dcbe" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 34619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:49.134948 31106 consensus_queue.cc:1035] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf3a1f6b1744d37984937f43e34632b" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 39853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:49.141124 31113 mvcc.cc:205] Tried to move back new op lower bound from 7316448416286941184 to 7316448416088997888. Current Snapshot: MvccSnapshot[applied={T|T < 7316448416286941184}]
I20260809 02:24:49.149627 30390 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:49.149773 30390 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:49.151968 30390 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5130dec58b446f59f914f8655d6ea67: Sending DeleteTablet for 3 replicas of tablet bdb97479e28b426cb94a54730d7b634a
I20260809 02:24:49.152639 30963 tablet_service.cc:1514] Processing DeleteTablet for tablet bdb97479e28b426cb94a54730d7b634a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:49 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:47062
I20260809 02:24:49.152635 30761 tablet_service.cc:1514] Processing DeleteTablet for tablet bdb97479e28b426cb94a54730d7b634a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:49 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:33656
I20260809 02:24:49.152858 30574 tablet_service.cc:1514] Processing DeleteTablet for tablet bdb97479e28b426cb94a54730d7b634a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:49 UTC) from {username='kudu', principal='kudu/127.1.81.254@KRBTEST.COM'} at 127.0.0.1:45990
I20260809 02:24:49.153122 31126 tablet_replica.cc:330] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: stopping tablet replica
I20260809 02:24:49.153440 31126 raft_consensus.cc:2229] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:24:49.153430 31129 tablet_replica.cc:330] T bdb97479e28b426cb94a54730d7b634a P 5c061012e738490ebf7336ff7b19dcbe: stopping tablet replica
I20260809 02:24:49.153939 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 30484
I20260809 02:24:49.161769 31126 raft_consensus.cc:2258] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:49.162184 31127 tablet_replica.cc:330] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: stopping tablet replica
I20260809 02:24:49.162443 31127 raft_consensus.cc:2229] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:49.162724 31127 raft_consensus.cc:2258] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:49.164206 31126 ts_tablet_manager.cc:1905] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:49.164206 31127 ts_tablet_manager.cc:1905] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:49.166940 31126 ts_tablet_manager.cc:1918] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:49.166940 31127 ts_tablet_manager.cc:1918] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:49.167040 31127 log.cc:1196] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/bdb97479e28b426cb94a54730d7b634a
I20260809 02:24:49.167116 31126 log.cc:1196] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/bdb97479e28b426cb94a54730d7b634a
I20260809 02:24:49.167434 31127 ts_tablet_manager.cc:1939] T bdb97479e28b426cb94a54730d7b634a P 3bf3a1f6b1744d37984937f43e34632b: Deleting consensus metadata
I20260809 02:24:49.167470 31126 ts_tablet_manager.cc:1939] T bdb97479e28b426cb94a54730d7b634a P 6744f20830674d5d851a0aec0ae1de70: Deleting consensus metadata
I20260809 02:24:49.168638 30371 catalog_manager.cc:4841] TS 3bf3a1f6b1744d37984937f43e34632b (127.1.81.194:39853): tablet bdb97479e28b426cb94a54730d7b634a (table test-table [id=ddf833001f5d45178e8071ffe94309d8]) successfully deleted
I20260809 02:24:49.168855 30374 catalog_manager.cc:4841] TS 6744f20830674d5d851a0aec0ae1de70 (127.1.81.195:45445): tablet bdb97479e28b426cb94a54730d7b634a (table test-table [id=ddf833001f5d45178e8071ffe94309d8]) successfully deleted
W20260809 02:24:49.172744 30375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:34619 (error 108)
I20260809 02:24:49.173552 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 30677
I20260809 02:24:49.179669 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.179344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:34619 (local address 127.0.0.1:45994)
0809 02:24:49.179497 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:49.179571 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:34619: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 02:24:49.179898 30375 catalog_manager.cc:4584] TS 5c061012e738490ebf7336ff7b19dcbe (127.1.81.193:34619): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bdb97479e28b426cb94a54730d7b634a: Network error: Client connection negotiation failed: client connection to 127.1.81.193:34619: connect: Connection refused (error 111)
I20260809 02:24:49.186151 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 30863
I20260809 02:24:49.196303 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 30350
2026-08-09T02:24:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2489 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T02:24:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:49Z Disabled control of system clock
I20260809 02:24:49.242599 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44329
--webserver_interface=127.1.81.254
--webserver_port=0
--builtin_ntp_servers=127.1.81.212:44567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:44329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:24:49.350136 31141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:49.350363 31141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:49.350411 31141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:49.354239 31141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:49.354290 31141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:49.354310 31141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:49.354331 31141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:49.354358 31141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:49.358839 31141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:44329
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:49.359690 31141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:49.360884 31141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:49.368404 31150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:49.368413 31149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:49.368419 31155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:49.368597 31141 server_base.cc:1034] running on GCE node
I20260809 02:24:49.369402 31141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:49.370383 31141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:49.371553 31141 hybrid_clock.cc:648] HybridClock initialized: now 1786242289371523 us; error 35 us; skew 500 ppm
I20260809 02:24:49.373229 31141 webserver.cc:460] Webserver started at http://127.1.81.254:37999/ using document root <none> and password file <none>
I20260809 02:24:49.373728 31141 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:49.373795 31141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:49.373983 31141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:49.375787 31141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "934234783a3d4eb1b3fc249f54aa8801"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "c8d4890cd5983979bfd4bb43e064db49"
server_key_iv: "c8b62d075f94094e82d8213b3046f740"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.376344 31141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "934234783a3d4eb1b3fc249f54aa8801"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "c8d4890cd5983979bfd4bb43e064db49"
server_key_iv: "c8b62d075f94094e82d8213b3046f740"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.379549 31141 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 02:24:49.381770 31164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:49.382831 31141 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:24:49.382946 31141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "934234783a3d4eb1b3fc249f54aa8801"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "c8d4890cd5983979bfd4bb43e064db49"
server_key_iv: "c8b62d075f94094e82d8213b3046f740"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.383042 31141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:49.401048 31141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:49.401585 31141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:49.401741 31141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:49.407986 31141 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:44329
I20260809 02:24:49.408000 31243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:44329 every 8 connection(s)
I20260809 02:24:49.408792 31141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:49.411628 31244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:49.416941 31244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801: Bootstrap starting.
I20260809 02:24:49.417351 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 31141
I20260809 02:24:49.417476 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:49.417791 1351 external_mini_cluster.cc:1428] Setting key e2fea326ffb2135395fe9169ca4ef163
I20260809 02:24:49.419425 31244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:49.420167 31244 log.cc:824] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:49.421888 31244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801: No bootstrap required, opened a new log
I20260809 02:24:49.425225 31244 raft_consensus.cc:348] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934234783a3d4eb1b3fc249f54aa8801" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44329 } }
I20260809 02:24:49.425424 31244 raft_consensus.cc:374] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:49.425478 31244 raft_consensus.cc:729] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934234783a3d4eb1b3fc249f54aa8801, State: Initialized, Role: FOLLOWER
I20260809 02:24:49.425873 31244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934234783a3d4eb1b3fc249f54aa8801" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44329 } }
I20260809 02:24:49.426004 31244 raft_consensus.cc:388] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:49.426065 31244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:49.426170 31244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:49.426550 31248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.419021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55644 (local address 127.1.81.254:44329)
0809 02:24:49.419679 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:49.419699 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:49.419742 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:24:49.420548 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:49.420568 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:49.420873 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:49.421164 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:49.421547 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.422501 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.423377 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.423878 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.424020 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.424829 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:49.424834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:49.424847 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:49.425187 (+ 340us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:49.425243 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:49.425261 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:49.425345 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:49.425480 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 02:24:49.425828 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":119,"threads_started":1}
I20260809 02:24:49.426954 31244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934234783a3d4eb1b3fc249f54aa8801" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44329 } }
I20260809 02:24:49.427256 31244 leader_election.cc:302] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 934234783a3d4eb1b3fc249f54aa8801; no voters:
I20260809 02:24:49.427520 31244 leader_election.cc:288] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:49.427598 31251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:49.427763 31251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [term 1 LEADER]: Becoming Leader. State: Replica: 934234783a3d4eb1b3fc249f54aa8801, State: Running, Role: LEADER
I20260809 02:24:49.428067 31251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934234783a3d4eb1b3fc249f54aa8801" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44329 } }
I20260809 02:24:49.428717 31244 sys_catalog.cc:564] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:49.429629 31252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 934234783a3d4eb1b3fc249f54aa8801. Latest consensus state: current_term: 1 leader_uuid: "934234783a3d4eb1b3fc249f54aa8801" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934234783a3d4eb1b3fc249f54aa8801" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44329 } } }
I20260809 02:24:49.429755 31252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:49.430032 31253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "934234783a3d4eb1b3fc249f54aa8801" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934234783a3d4eb1b3fc249f54aa8801" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44329 } } }
I20260809 02:24:49.430125 31253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:49.430130 31262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:49.432677 31262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:49.437588 31262 catalog_manager.cc:1347] Generated new cluster ID: 725858f679ad4a1aa8789fcb29ed5f1d
I20260809 02:24:49.437659 31262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:49.456885 31262 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:49.457989 31262 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:49.464182 31262 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801: Generated new TSK 0
I20260809 02:24:49.464840 31262 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:49.473261 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.193:0
--local_ip_for_outbound_sockets=127.1.81.193
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44329
--builtin_ntp_servers=127.1.81.212:44567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:24:49.580999 31274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:49.581210 31274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:49.581244 31274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:49.585140 31274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:49.585186 31274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:49.585233 31274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.193
I20260809 02:24:49.589804 31274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.81.193
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.193
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:49.590607 31274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:49.591794 31274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:24:49.600638 31274 server_base.cc:1034] running on GCE node
W20260809 02:24:49.600617 31284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:49.600615 31289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:49.600806 31287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:49.601178 31274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:49.601729 31274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:49.602880 31274 hybrid_clock.cc:648] HybridClock initialized: now 1786242289602867 us; error 24 us; skew 500 ppm
I20260809 02:24:49.606977 31274 webserver.cc:460] Webserver started at http://127.1.81.193:46567/ using document root <none> and password file <none>
I20260809 02:24:49.607475 31274 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:49.607535 31274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:49.607722 31274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:49.609601 31274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/data/instance:
uuid: "dc8d13e32dec4d249d2a062ffbc363b4"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "26c097ed12af1e4fcea78bc503c5a3a2"
server_key_iv: "950e61dacff664927fbf925d48fde29b"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.610096 31274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance:
uuid: "dc8d13e32dec4d249d2a062ffbc363b4"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "26c097ed12af1e4fcea78bc503c5a3a2"
server_key_iv: "950e61dacff664927fbf925d48fde29b"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.613443 31274 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:24:49.615550 31297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:49.616629 31274 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:49.616745 31274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/wal
uuid: "dc8d13e32dec4d249d2a062ffbc363b4"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "26c097ed12af1e4fcea78bc503c5a3a2"
server_key_iv: "950e61dacff664927fbf925d48fde29b"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.616833 31274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:49.666853 31274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:49.667426 31274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:49.667582 31274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:49.668133 31274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:49.668977 31274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:49.669023 31274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:49.669073 31274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:49.669098 31274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:49.677095 31274 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.193:43715
I20260809 02:24:49.677119 31468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.193:43715 every 8 connection(s)
I20260809 02:24:49.677855 31274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/data/info.pb
I20260809 02:24:49.680037 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 31274
I20260809 02:24:49.680169 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-0/wal/instance
I20260809 02:24:49.680446 1351 external_mini_cluster.cc:1428] Setting key 0ceabdc738853465e48da1ef29ef8988
I20260809 02:24:49.682345 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.194:0
--local_ip_for_outbound_sockets=127.1.81.194
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44329
--builtin_ntp_servers=127.1.81.212:44567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:24:49.686694 31248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.679443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.193:33707 (local address 127.1.81.254:44329)
0809 02:24:49.679573 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:49.679577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:49.680638 (+ 1061us) server_negotiation.cc:407] Connection header received
0809 02:24:49.681929 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:49.681933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:49.681985 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:49.682086 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:49.683004 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.683718 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.684831 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.685162 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.685274 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.686243 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:49.686247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:49.686249 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:49.686261 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:49.686279 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:49.686286 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:49.686342 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:49.686490 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 02:24:49.686535 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:24:49.687723 31471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.679784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:44329 (local address 127.1.81.193:33707)
0809 02:24:49.680488 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:49.680536 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:49.681735 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:49.682249 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:49.682255 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:49.682336 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:49.682864 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:49.682877 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.683848 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.683851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:49.684712 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:49.684721 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.685291 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.685293 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:49.685423 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.685971 (+ 548us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:49.685973 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:49.686022 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:49.686094 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:49.686363 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:49.686372 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:49.686378 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:24:49.686496 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 02:24:49.686752 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":113,"threads_started":1}
I20260809 02:24:49.688889 31469 heartbeater.cc:347] Connected to a master server at 127.1.81.254:44329
I20260809 02:24:49.689085 31469 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:49.689512 31469 heartbeater.cc:511] Master 127.1.81.254:44329 requested a full tablet report, sending...
I20260809 02:24:49.691020 31187 ts_manager.cc:194] Registered new tserver with Master: dc8d13e32dec4d249d2a062ffbc363b4 (127.1.81.193:43715)
I20260809 02:24:49.692642 31187 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.193:33707
W20260809 02:24:49.790397 31472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:49.790612 31472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:49.790647 31472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:49.794453 31472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:49.794492 31472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:49.794539 31472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.194
I20260809 02:24:49.798960 31472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.81.194
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.194
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:49.799760 31472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:49.800923 31472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:49.809453 31485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:49.809473 31482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:49.809461 31480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:49.810137 31472 server_base.cc:1034] running on GCE node
I20260809 02:24:49.810447 31472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:49.810943 31472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:49.812090 31472 hybrid_clock.cc:648] HybridClock initialized: now 1786242289812077 us; error 23 us; skew 500 ppm
I20260809 02:24:49.813630 31472 webserver.cc:460] Webserver started at http://127.1.81.194:43959/ using document root <none> and password file <none>
I20260809 02:24:49.814086 31472 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:49.814141 31472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:49.814291 31472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:49.816092 31472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/data/instance:
uuid: "abc119a8698a41edaeff61f196ae34f9"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "cbd7d85bff4e35cd28c084f047b6652c"
server_key_iv: "ae1387fdb4b029f59e7a475b59be143b"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.816553 31472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance:
uuid: "abc119a8698a41edaeff61f196ae34f9"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "cbd7d85bff4e35cd28c084f047b6652c"
server_key_iv: "ae1387fdb4b029f59e7a475b59be143b"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.819707 31472 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:24:49.821830 31495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:49.822871 31472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:49.822961 31472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/wal
uuid: "abc119a8698a41edaeff61f196ae34f9"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "cbd7d85bff4e35cd28c084f047b6652c"
server_key_iv: "ae1387fdb4b029f59e7a475b59be143b"
server_key_version: "encryptionkey@0"
I20260809 02:24:49.823035 31472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:49.839847 31472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:49.840356 31472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:49.840484 31472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:49.840942 31472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:49.841739 31472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:49.841784 31472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:49.841818 31472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:49.841837 31472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:49.849789 31472 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.194:37357
I20260809 02:24:49.849849 31659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.194:37357 every 8 connection(s)
I20260809 02:24:49.850544 31472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/data/info.pb
I20260809 02:24:49.858738 31248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.852078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.194:51827 (local address 127.1.81.254:44329)
0809 02:24:49.852206 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:49.852210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:49.853136 (+ 926us) server_negotiation.cc:407] Connection header received
0809 02:24:49.854440 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:49.854444 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:49.854500 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:49.854571 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:49.855379 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.855946 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.857033 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.857259 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.857349 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.858293 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:49.858297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:49.858300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:49.858314 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:49.858332 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:49.858340 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:49.858398 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:49.858530 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 02:24:49.858592 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:24:49.859403 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 31472
I20260809 02:24:49.859483 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:49.852423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:44329 (local address 127.1.81.194:51827)
0809 02:24:49.853006 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:49.853042 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:49.854247 (+ 1205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:49.854741 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:49.854748 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:49.854822 (+ 74us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:49.855239 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:49.855251 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.856065 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.856068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:49.856908 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:49.856919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:49.857398 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:49.857403 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:49.857548 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:49.858053 (+ 505us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:49.858055 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:49.858091 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:49.858151 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:49.858408 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:49.858417 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:49.858423 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:24:49.858522 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 02:24:49.858773 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":105,"threads_started":1}
I20260809 02:24:49.859519 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/wal/instance
I20260809 02:24:49.859833 1351 external_mini_cluster.cc:1428] Setting key e1fdf271d5641fe702eaaeda6d9c4f06
I20260809 02:24:49.860512 31660 heartbeater.cc:347] Connected to a master server at 127.1.81.254:44329
I20260809 02:24:49.860726 31660 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:49.861207 31660 heartbeater.cc:511] Master 127.1.81.254:44329 requested a full tablet report, sending...
I20260809 02:24:49.861649 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.81.195:0
--local_ip_for_outbound_sockets=127.1.81.195
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44329
--builtin_ntp_servers=127.1.81.212:44567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:24:49.862146 31187 ts_manager.cc:194] Registered new tserver with Master: abc119a8698a41edaeff61f196ae34f9 (127.1.81.194:37357)
I20260809 02:24:49.862789 31187 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.194:51827
W20260809 02:24:49.975739 31665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:49.975992 31665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:49.976044 31665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:49.979941 31665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:49.979983 31665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:49.980055 31665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.81.195
I20260809 02:24:49.984639 31665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.81.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.81.195
--webserver_port=0
--tserver_master_addrs=127.1.81.254:44329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.81.195
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:49.985479 31665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:49.986658 31665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:49.995465 31671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:49.995441 31673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:49.995546 31665 server_base.cc:1034] running on GCE node
W20260809 02:24:49.995455 31675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:49.996083 31665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:49.996613 31665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:49.997778 31665 hybrid_clock.cc:648] HybridClock initialized: now 1786242289997765 us; error 23 us; skew 500 ppm
I20260809 02:24:49.999382 31665 webserver.cc:460] Webserver started at http://127.1.81.195:46085/ using document root <none> and password file <none>
I20260809 02:24:49.999900 31665 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:49.999966 31665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:50.000123 31665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:50.001914 31665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/data/instance:
uuid: "2ebb57bc20464cbcb8a120c6a843f71d"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "9f394e98ba23c1f83d7b5dfe4d04f241"
server_key_iv: "3b7bd22c6da89be7cbc92945eaeeab69"
server_key_version: "encryptionkey@0"
I20260809 02:24:50.002378 31665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance:
uuid: "2ebb57bc20464cbcb8a120c6a843f71d"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "9f394e98ba23c1f83d7b5dfe4d04f241"
server_key_iv: "3b7bd22c6da89be7cbc92945eaeeab69"
server_key_version: "encryptionkey@0"
I20260809 02:24:50.005615 31665 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:24:50.007714 31684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:50.008797 31665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:50.008889 31665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/wal
uuid: "2ebb57bc20464cbcb8a120c6a843f71d"
format_stamp: "Formatted at 2026-08-09 02:24:49 on dist-test-slave-jlzn"
server_key: "9f394e98ba23c1f83d7b5dfe4d04f241"
server_key_iv: "3b7bd22c6da89be7cbc92945eaeeab69"
server_key_version: "encryptionkey@0"
I20260809 02:24:50.008967 31665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:50.024863 31665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:50.025444 31665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:50.025576 31665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:50.026075 31665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:24:50.026952 31665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:24:50.027010 31665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:50.027053 31665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:24:50.027073 31665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:50.035449 31665 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.195:34369
I20260809 02:24:50.035473 31862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.195:34369 every 8 connection(s)
I20260809 02:24:50.036242 31665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/data/info.pb
I20260809 02:24:50.039680 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 31665
I20260809 02:24:50.039783 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/wal/instance
I20260809 02:24:50.040035 1351 external_mini_cluster.cc:1428] Setting key b51364b29009ebd2175177d4672ed86b
I20260809 02:24:50.044943 31248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.037790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:36673 (local address 127.1.81.254:44329)
0809 02:24:50.037919 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:50.037923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:50.038830 (+ 907us) server_negotiation.cc:407] Connection header received
0809 02:24:50.040191 (+ 1361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:50.040194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:50.040249 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:50.040339 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:50.041443 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.042042 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.043086 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.043303 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.043389 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.044484 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:50.044488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:50.044490 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:50.044503 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:50.044523 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:50.044531 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:50.044588 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:50.044771 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 02:24:50.044831 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:24:50.046170 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.038109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:44329 (local address 127.1.81.195:36673)
0809 02:24:50.038700 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:50.038737 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:50.039988 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:50.040646 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:50.040654 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:50.040752 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:24:50.041304 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.041325 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.042168 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.042171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.042996 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.043006 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.043423 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.043427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.043601 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.044233 (+ 632us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:24:50.044235 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:24:50.044286 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:24:50.044354 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:24:50.044599 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:24:50.044608 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:24:50.044614 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:24:50.045101 (+ 487us) client_negotiation.cc:240] Negotiation successful
0809 02:24:50.045365 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":102,"threads_started":1}
I20260809 02:24:50.047107 31864 heartbeater.cc:347] Connected to a master server at 127.1.81.254:44329
I20260809 02:24:50.047310 31864 heartbeater.cc:464] Registering TS with master...
I20260809 02:24:50.047752 31864 heartbeater.cc:511] Master 127.1.81.254:44329 requested a full tablet report, sending...
I20260809 02:24:50.048686 31187 ts_manager.cc:194] Registered new tserver with Master: 2ebb57bc20464cbcb8a120c6a843f71d (127.1.81.195:34369)
I20260809 02:24:50.049208 31187 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.81.195:36673
I20260809 02:24:50.053390 1351 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:24:50.058519 31248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.055080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55658 (local address 127.1.81.254:44329)
0809 02:24:50.055206 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:50.055210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:50.055381 (+ 171us) server_negotiation.cc:407] Connection header received
0809 02:24:50.055492 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:50.055495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:50.055534 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:50.055593 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:50.055879 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.056359 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.057186 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.057385 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.057466 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.058158 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:50.058162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:50.058165 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:50.058177 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:50.058193 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:50.058200 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:50.058257 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:50.058348 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 02:24:50.058398 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:24:50.060874 31187 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55658:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:24:50.063630 31187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:24:50.076805 31890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.071022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.195:34369 (local address 127.0.0.1:50704)
0809 02:24:50.071578 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:50.071628 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:50.071753 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:50.072497 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:50.072503 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:50.072536 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:50.072708 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.072715 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.074100 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.074103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.075498 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.075505 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.076302 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.076306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.076410 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.076447 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:24:50.076549 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:24:50.076669 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":161,"spinlock_wait_cycles":6272,"thread_start_us":99,"threads_started":1}
I20260809 02:24:50.076812 31893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.071125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50704 (local address 127.1.81.195:34369)
0809 02:24:50.071432 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:50.071443 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:50.071869 (+ 426us) server_negotiation.cc:407] Connection header received
0809 02:24:50.072017 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:50.072022 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:50.072212 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:50.072354 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:50.072819 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.073967 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.075623 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.076193 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.076287 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.076449 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:50.076584 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 02:24:50.076668 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":130,"threads_started":1}
I20260809 02:24:50.077107 31894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.072052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56528 (local address 127.1.81.193:43715)
0809 02:24:50.072467 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:50.072480 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:50.072724 (+ 244us) server_negotiation.cc:407] Connection header received
0809 02:24:50.072814 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:50.072818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:50.072948 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:50.073072 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:50.073254 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.073954 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.075468 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.076256 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.076364 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.076538 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:50.076854 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 02:24:50.076943 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":113,"threads_started":1}
I20260809 02:24:50.077346 31886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.070961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52090 (local address 127.1.81.194:37357)
0809 02:24:50.071642 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:50.071655 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:50.072001 (+ 346us) server_negotiation.cc:407] Connection header received
0809 02:24:50.072078 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:50.072083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:50.072227 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:50.072354 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:50.072823 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.073967 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.075608 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.076386 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.076479 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.076631 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:50.077086 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 02:24:50.077187 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":97,"threads_started":1}
I20260809 02:24:50.077723 31895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.072398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:43715 (local address 127.0.0.1:56528)
0809 02:24:50.072606 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:50.072618 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:50.072718 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:50.073064 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:50.073067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:50.073084 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:50.073163 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.073169 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.074062 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.074066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.075342 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.075353 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.076604 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.076607 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.076693 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.076720 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:24:50.077309 (+ 589us) client_negotiation.cc:240] Negotiation successful
0809 02:24:50.077599 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":39,"thread_start_us":83,"threads_started":1}
I20260809 02:24:50.077910 31885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.070857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:37357 (local address 127.0.0.1:52090)
0809 02:24:50.071785 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:50.071798 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:50.071903 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:50.072497 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:50.072503 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:50.072538 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:50.072684 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.072693 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.074100 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.074103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.075484 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.075497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.076696 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.076700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.076771 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.076791 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:24:50.076847 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 02:24:50.077771 (+ 924us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":97,"spinlock_wait_cycles":6144,"thread_start_us":78,"threads_started":1}
I20260809 02:24:50.080166 31374 tablet_service.cc:1467] Processing CreateTablet for tablet 8e62fa10ab3e4d7587ed649cf18ee570 (DEFAULT_TABLE table=test-table [id=e94ce994bcaa4ef382dfea716c788740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:50.080329 31766 tablet_service.cc:1467] Processing CreateTablet for tablet 8e62fa10ab3e4d7587ed649cf18ee570 (DEFAULT_TABLE table=test-table [id=e94ce994bcaa4ef382dfea716c788740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:50.080328 31567 tablet_service.cc:1467] Processing CreateTablet for tablet 8e62fa10ab3e4d7587ed649cf18ee570 (DEFAULT_TABLE table=test-table [id=e94ce994bcaa4ef382dfea716c788740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:24:50.081046 31374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e62fa10ab3e4d7587ed649cf18ee570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:50.081298 31567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e62fa10ab3e4d7587ed649cf18ee570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:50.081298 31766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e62fa10ab3e4d7587ed649cf18ee570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:50.087735 31897 tablet_bootstrap.cc:492] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4: Bootstrap starting.
I20260809 02:24:50.088551 31901 tablet_bootstrap.cc:492] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Bootstrap starting.
I20260809 02:24:50.089756 31897 tablet_bootstrap.cc:654] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:50.090240 31901 tablet_bootstrap.cc:654] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:50.090476 31897 log.cc:824] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:50.090888 31901 log.cc:824] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:50.091511 31899 tablet_bootstrap.cc:492] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: Bootstrap starting.
I20260809 02:24:50.092314 31897 tablet_bootstrap.cc:492] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4: No bootstrap required, opened a new log
I20260809 02:24:50.092501 31897 ts_tablet_manager.cc:1397] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260809 02:24:50.092797 31901 tablet_bootstrap.cc:492] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: No bootstrap required, opened a new log
I20260809 02:24:50.092978 31901 ts_tablet_manager.cc:1397] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:24:50.093330 31899 tablet_bootstrap.cc:654] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:50.093943 31899 log.cc:824] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:50.095526 31899 tablet_bootstrap.cc:492] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: No bootstrap required, opened a new log
I20260809 02:24:50.095700 31899 ts_tablet_manager.cc:1397] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 02:24:50.096644 31897 raft_consensus.cc:348] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.096909 31897 raft_consensus.cc:374] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:50.096979 31897 raft_consensus.cc:729] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc8d13e32dec4d249d2a062ffbc363b4, State: Initialized, Role: FOLLOWER
I20260809 02:24:50.096921 31901 raft_consensus.cc:348] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.097167 31901 raft_consensus.cc:374] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:50.097226 31901 raft_consensus.cc:729] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abc119a8698a41edaeff61f196ae34f9, State: Initialized, Role: FOLLOWER
I20260809 02:24:50.097455 31897 consensus_queue.cc:260] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.097584 31901 consensus_queue.cc:260] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.098119 31469 heartbeater.cc:503] Master 127.1.81.254:44329 was elected leader, sending a full tablet report...
I20260809 02:24:50.098440 31897 ts_tablet_manager.cc:1428] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:24:50.098440 31901 ts_tablet_manager.cc:1428] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:24:50.098740 31660 heartbeater.cc:503] Master 127.1.81.254:44329 was elected leader, sending a full tablet report...
I20260809 02:24:50.099303 31899 raft_consensus.cc:348] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.099550 31899 raft_consensus.cc:374] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:50.099606 31899 raft_consensus.cc:729] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ebb57bc20464cbcb8a120c6a843f71d, State: Initialized, Role: FOLLOWER
I20260809 02:24:50.099997 31899 consensus_queue.cc:260] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.100571 31864 heartbeater.cc:503] Master 127.1.81.254:44329 was elected leader, sending a full tablet report...
I20260809 02:24:50.100826 31899 ts_tablet_manager.cc:1428] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260809 02:24:50.101490 31662 tablet.cc:2369] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:50.176393 31913 raft_consensus.cc:482] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:24:50.176561 31913 raft_consensus.cc:504] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.177551 31913 leader_election.cc:288] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abc119a8698a41edaeff61f196ae34f9 (127.1.81.194:37357), dc8d13e32dec4d249d2a062ffbc363b4 (127.1.81.193:43715)
W20260809 02:24:50.178908 31470 tablet.cc:2369] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:24:50.181243 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.177732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.194:37357 (local address 127.1.81.195:46759)
0809 02:24:50.177907 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:50.177921 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:50.178004 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:50.178255 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:50.178258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:50.178304 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:50.178405 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.178410 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.179282 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.179286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.180184 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.180195 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.180847 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.180850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.180948 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.180975 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:24:50.181046 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:24:50.181108 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":1,"spinlock_wait_cycles":4992}
I20260809 02:24:50.181288 31886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.177860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:46759 (local address 127.1.81.194:37357)
0809 02:24:50.177976 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:50.177980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:50.177995 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:24:50.178111 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:50.178115 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:50.178171 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:50.178234 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:50.178514 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.179164 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.180307 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.180740 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.180831 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.180869 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:50.181074 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 02:24:50.181161 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:24:50.181376 31894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.177884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.81.195:36385 (local address 127.1.81.193:43715)
0809 02:24:50.178004 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:50.178009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:50.178269 (+ 260us) server_negotiation.cc:407] Connection header received
0809 02:24:50.178407 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:50.178410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:50.178453 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:50.178512 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:24:50.178797 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.179385 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.180465 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.180865 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.180970 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.181014 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:50.181200 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 02:24:50.181270 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:24:50.181422 31915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.177788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:43715 (local address 127.1.81.195:36385)
0809 02:24:50.178175 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:50.178186 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:24:50.178307 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:24:50.178537 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:24:50.178539 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:24:50.178555 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:24:50.178673 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.178679 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.179491 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.179493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.180339 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:24:50.180350 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.180981 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.180984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:24:50.181077 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.181102 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:24:50.181170 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 02:24:50.181235 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"spinlock_wait_cycles":29184,"thread_start_us":127,"threads_started":1}
I20260809 02:24:50.181926 31599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e62fa10ab3e4d7587ed649cf18ee570" candidate_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abc119a8698a41edaeff61f196ae34f9" is_pre_election: true
I20260809 02:24:50.181993 31404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e62fa10ab3e4d7587ed649cf18ee570" candidate_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" is_pre_election: true
I20260809 02:24:50.182232 31599 raft_consensus.cc:2454] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ebb57bc20464cbcb8a120c6a843f71d in term 0.
I20260809 02:24:50.182232 31404 raft_consensus.cc:2454] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ebb57bc20464cbcb8a120c6a843f71d in term 0.
I20260809 02:24:50.182761 31689 leader_election.cc:302] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2ebb57bc20464cbcb8a120c6a843f71d, abc119a8698a41edaeff61f196ae34f9, dc8d13e32dec4d249d2a062ffbc363b4; no voters:
I20260809 02:24:50.183032 31913 raft_consensus.cc:2781] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:24:50.183109 31913 raft_consensus.cc:482] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:24:50.183169 31913 raft_consensus.cc:3037] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:50.184191 31913 raft_consensus.cc:504] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.184497 31913 leader_election.cc:288] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [CANDIDATE]: Term 1 election: Requested vote from peers abc119a8698a41edaeff61f196ae34f9 (127.1.81.194:37357), dc8d13e32dec4d249d2a062ffbc363b4 (127.1.81.193:43715)
I20260809 02:24:50.184815 31404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e62fa10ab3e4d7587ed649cf18ee570" candidate_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc8d13e32dec4d249d2a062ffbc363b4"
I20260809 02:24:50.184821 31599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e62fa10ab3e4d7587ed649cf18ee570" candidate_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abc119a8698a41edaeff61f196ae34f9"
I20260809 02:24:50.184917 31404 raft_consensus.cc:3037] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:50.184928 31599 raft_consensus.cc:3037] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:50.185942 31599 raft_consensus.cc:2454] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ebb57bc20464cbcb8a120c6a843f71d in term 1.
I20260809 02:24:50.185961 31404 raft_consensus.cc:2454] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ebb57bc20464cbcb8a120c6a843f71d in term 1.
I20260809 02:24:50.186226 31689 leader_election.cc:302] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ebb57bc20464cbcb8a120c6a843f71d, abc119a8698a41edaeff61f196ae34f9; no voters:
I20260809 02:24:50.186388 31913 raft_consensus.cc:2781] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:50.186589 31913 raft_consensus.cc:686] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 1 LEADER]: Becoming Leader. State: Replica: 2ebb57bc20464cbcb8a120c6a843f71d, State: Running, Role: LEADER
I20260809 02:24:50.186932 31913 consensus_queue.cc:237] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } }
I20260809 02:24:50.189914 31187 catalog_manager.cc:5495] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ebb57bc20464cbcb8a120c6a843f71d (127.1.81.195). New cstate: current_term: 1 leader_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ebb57bc20464cbcb8a120c6a843f71d" member_type: VOTER last_known_addr { host: "127.1.81.195" port: 34369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 } health_report { overall_health: UNKNOWN } } }
I20260809 02:24:50.224766 31893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.221989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50706 (local address 127.1.81.195:34369)
0809 02:24:50.222093 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:50.222097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:50.222108 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:24:50.222167 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:50.222169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:50.222212 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:50.222288 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:24:50.222461 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.222930 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.223659 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:50.223894 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:50.223965 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:50.224168 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:24:50.224517 (+ 349us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:24:50.224598 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:50.224625 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 02:24:50.224674 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:24:50.229912 31404 raft_consensus.cc:1261] T 8e62fa10ab3e4d7587ed649cf18ee570 P dc8d13e32dec4d249d2a062ffbc363b4 [term 1 FOLLOWER]: Refusing update from remote peer 2ebb57bc20464cbcb8a120c6a843f71d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:50.229911 31599 raft_consensus.cc:1261] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 1 FOLLOWER]: Refusing update from remote peer 2ebb57bc20464cbcb8a120c6a843f71d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:24:50.230516 31913 consensus_queue.cc:1035] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "abc119a8698a41edaeff61f196ae34f9" member_type: VOTER last_known_addr { host: "127.1.81.194" port: 37357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:50.230691 31916 consensus_queue.cc:1035] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc8d13e32dec4d249d2a062ffbc363b4" member_type: VOTER last_known_addr { host: "127.1.81.193" port: 43715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:24:50.237277 31921 mvcc.cc:205] Tried to move back new op lower bound from 7316448420775677952 to 7316448420608188416. Current Snapshot: MvccSnapshot[applied={T|T < 7316448420775677952}]
I20260809 02:24:50.246251 31187 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:50.246378 31187 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:24:50.248507 31187 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 934234783a3d4eb1b3fc249f54aa8801: Sending DeleteTablet for 3 replicas of tablet 8e62fa10ab3e4d7587ed649cf18ee570
I20260809 02:24:50.249171 31766 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e62fa10ab3e4d7587ed649cf18ee570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:50 UTC) from {username='slave'} at 127.0.0.1:50704
I20260809 02:24:50.249235 31567 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e62fa10ab3e4d7587ed649cf18ee570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:50 UTC) from {username='slave'} at 127.0.0.1:52090
I20260809 02:24:50.249625 31931 tablet_replica.cc:330] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: stopping tablet replica
I20260809 02:24:50.249680 31932 tablet_replica.cc:330] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: stopping tablet replica
I20260809 02:24:50.249703 31374 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e62fa10ab3e4d7587ed649cf18ee570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:24:50 UTC) from {username='slave'} at 127.0.0.1:56528
I20260809 02:24:50.249964 31932 raft_consensus.cc:2229] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:24:50.249974 31931 raft_consensus.cc:2229] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:24:50.250245 31932 raft_consensus.cc:2258] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:50.250432 31931 raft_consensus.cc:2258] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:24:50.250737 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 31274
I20260809 02:24:50.251901 31932 ts_tablet_manager.cc:1905] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:50.254241 31932 ts_tablet_manager.cc:1918] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:50.254312 31932 log.cc:1196] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-1/wal/wals/8e62fa10ab3e4d7587ed649cf18ee570
I20260809 02:24:50.254540 31932 ts_tablet_manager.cc:1939] T 8e62fa10ab3e4d7587ed649cf18ee570 P abc119a8698a41edaeff61f196ae34f9: Deleting consensus metadata
I20260809 02:24:50.255460 31170 catalog_manager.cc:4841] TS abc119a8698a41edaeff61f196ae34f9 (127.1.81.194:37357): tablet 8e62fa10ab3e4d7587ed649cf18ee570 (table test-table [id=e94ce994bcaa4ef382dfea716c788740]) successfully deleted
I20260809 02:24:50.258704 31931 ts_tablet_manager.cc:1905] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:24:50.260692 31931 ts_tablet_manager.cc:1918] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:24:50.260777 31931 log.cc:1196] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: Deleting WAL directory at /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242040541704-1351-0/minicluster-data/ts-2/wal/wals/8e62fa10ab3e4d7587ed649cf18ee570
I20260809 02:24:50.261018 31931 ts_tablet_manager.cc:1939] T 8e62fa10ab3e4d7587ed649cf18ee570 P 2ebb57bc20464cbcb8a120c6a843f71d: Deleting consensus metadata
I20260809 02:24:50.261883 31168 catalog_manager.cc:4841] TS 2ebb57bc20464cbcb8a120c6a843f71d (127.1.81.195:34369): tablet 8e62fa10ab3e4d7587ed649cf18ee570 (table test-table [id=e94ce994bcaa4ef382dfea716c788740]) successfully deleted
W20260809 02:24:50.267189 31169 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.81.193:43715 (error 108)
I20260809 02:24:50.267343 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 31472
I20260809 02:24:50.271592 31885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:50.271306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.193:43715 (local address 127.0.0.1:56532)
0809 02:24:50.271447 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:24:50.271503 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.193:43715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260809 02:24:50.271845 31169 catalog_manager.cc:4584] TS dc8d13e32dec4d249d2a062ffbc363b4 (127.1.81.193:43715): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8e62fa10ab3e4d7587ed649cf18ee570: Network error: Client connection negotiation failed: client connection to 127.1.81.193:43715: connect: Connection refused (error 111)
I20260809 02:24:50.288791 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 31665
I20260809 02:24:50.305022 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 31141
2026-08-09T02:24:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1096 ms)
[----------] 6 tests from EncryptionPolicyTest (10522 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:50 dist-test-slave-jlzn krb5kdc[31937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:50 dist-test-slave-jlzn krb5kdc[31937](info): set up 2 sockets
Aug 09 02:24:50 dist-test-slave-jlzn krb5kdc[31937](info): commencing operation
krb5kdc: starting...
W20260809 02:24:51.430945 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:51 dist-test-slave-jlzn krb5kdc[31937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:24:51.542488 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38941
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:51.647783 31952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:51.648010 31952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:51.648054 31952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:51.651870 31952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:51.651916 31952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:51.651945 31952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:51.651974 31952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:51.651999 31952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:51.656853 31952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38941
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:51.657681 31952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:51.658540 31952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:51.666224 31965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:51.666216 31961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:51.666216 31960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:51.666348 31952 server_base.cc:1034] running on GCE node
I20260809 02:24:51.667007 31952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:51.667939 31952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:51.669088 31952 hybrid_clock.cc:648] HybridClock initialized: now 1786242291669073 us; error 25 us; skew 500 ppm
Aug 09 02:24:51 dist-test-slave-jlzn krb5kdc[31937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242291, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:51.671618 31952 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:24:51.672434 31952 webserver.cc:460] Webserver started at http://127.0.0.1:34313/ using document root <none> and password file <none>
I20260809 02:24:51.672899 31952 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:51.672957 31952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:51.673138 31952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:51.674911 31952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "3d85efc399bb4fbca6fa905803b2d34f"
format_stamp: "Formatted at 2026-08-09 02:24:51 on dist-test-slave-jlzn"
server_key: "ec7f896d1fa8406ca122be8bca59fb55"
server_key_iv: "a87cdedbe3a65b1ad14322e97bb66c27"
server_key_version: "encryptionkey@0"
I20260809 02:24:51.675524 31952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "3d85efc399bb4fbca6fa905803b2d34f"
format_stamp: "Formatted at 2026-08-09 02:24:51 on dist-test-slave-jlzn"
server_key: "ec7f896d1fa8406ca122be8bca59fb55"
server_key_iv: "a87cdedbe3a65b1ad14322e97bb66c27"
server_key_version: "encryptionkey@0"
I20260809 02:24:51.678891 31952 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 02:24:51.681015 31973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:51.682056 31952 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:24:51.682175 31952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "3d85efc399bb4fbca6fa905803b2d34f"
format_stamp: "Formatted at 2026-08-09 02:24:51 on dist-test-slave-jlzn"
server_key: "ec7f896d1fa8406ca122be8bca59fb55"
server_key_iv: "a87cdedbe3a65b1ad14322e97bb66c27"
server_key_version: "encryptionkey@0"
I20260809 02:24:51.682261 31952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:51.700338 31952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:51.702639 31952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:51.702790 31952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:51.709255 31952 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38941
I20260809 02:24:51.709275 32058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38941 every 8 connection(s)
I20260809 02:24:51.710031 31952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:51.712531 32059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:51.717168 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 31952
I20260809 02:24:51.717280 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:51.717404 32059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f: Bootstrap starting.
I20260809 02:24:51.717540 1351 external_mini_cluster.cc:1428] Setting key c655a34735826a468b0894a1e073d17f
I20260809 02:24:51.719620 32059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:51.720381 32059 log.cc:824] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:51.722132 32059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f: No bootstrap required, opened a new log
Aug 09 02:24:51 dist-test-slave-jlzn krb5kdc[31937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:24:51.726114 32059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d85efc399bb4fbca6fa905803b2d34f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } }
I20260809 02:24:51.726364 32059 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:51.726437 32059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d85efc399bb4fbca6fa905803b2d34f, State: Initialized, Role: FOLLOWER
I20260809 02:24:51.726819 32059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d85efc399bb4fbca6fa905803b2d34f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } }
I20260809 02:24:51.726946 32059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:51.727010 32059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:51.727105 32059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:51.727880 32059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d85efc399bb4fbca6fa905803b2d34f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } }
I20260809 02:24:51.728185 32059 leader_election.cc:302] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d85efc399bb4fbca6fa905803b2d34f; no voters:
I20260809 02:24:51.728497 32059 leader_election.cc:288] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:51.728560 32068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:51.728753 32068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [term 1 LEADER]: Becoming Leader. State: Replica: 3d85efc399bb4fbca6fa905803b2d34f, State: Running, Role: LEADER
I20260809 02:24:51.729049 32068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d85efc399bb4fbca6fa905803b2d34f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } }
I20260809 02:24:51.729761 32059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:51.731302 32070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d85efc399bb4fbca6fa905803b2d34f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d85efc399bb4fbca6fa905803b2d34f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } } }
I20260809 02:24:51.731416 32070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:51.731769 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:51.718693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43025 (local address 127.0.0.1:38941)
0809 02:24:51.719037 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:51.719052 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:51.719084 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:24:51.719670 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:51.719685 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:51.720043 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:51.720297 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:51.721131 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:51.722057 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:51.723169 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:51.723601 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:51.723725 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:51.726445 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:51.726452 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:51.726467 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:51.726499 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:51.728154 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:51.728775 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:51.728782 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:51.728788 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:51.728983 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:51.729441 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:51.729444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:51.729446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:51.729932 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:51.730135 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:51.730631 (+ 496us) server_negotiation.cc:299] Negotiation successful
0809 02:24:51.730848 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":93,"threads_started":1}
I20260809 02:24:51.731879 32074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d85efc399bb4fbca6fa905803b2d34f. Latest consensus state: current_term: 1 leader_uuid: "3d85efc399bb4fbca6fa905803b2d34f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d85efc399bb4fbca6fa905803b2d34f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } } }
I20260809 02:24:51.731978 32074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:51.734472 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 02:24:51.734982 32093 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:24:51.735100 32093 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:24:51.735253 32092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:51.736313 32092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:51.741813 32092 catalog_manager.cc:1347] Generated new cluster ID: d81e89b7ca1e4ddda05f5439ce4b1682
I20260809 02:24:51.741874 32092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:51.745402 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:51.736453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41043 (local address 127.0.0.1:38941)
0809 02:24:51.737941 (+ 1488us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:51.737945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:51.737956 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:24:51.737982 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:51.737984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:51.738015 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:51.738085 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:51.738709 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:51.739473 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:51.740434 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:51.740655 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:51.740740 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:51.742161 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:51.742165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:51.742168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:51.742193 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:51.743708 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:51.744225 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:51.744229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:51.744230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:51.744317 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:51.744602 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:51.744605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:51.744607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:51.744803 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:51.744944 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:51.745166 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 02:24:51.745257 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1434}
I20260809 02:24:51.749209 32092 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:51.749987 32092 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:51.753774 32092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d85efc399bb4fbca6fa905803b2d34f: Generated new TSK 0
I20260809 02:24:51.754300 32092 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:51.759114 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 31952
W20260809 02:24:51.777772 31935 connection.cc:535] client connection to 127.0.0.1:38941 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38941): Connection reset by peer (error 104)
2026-08-09T02:24:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:51 dist-test-slave-jlzn krb5kdc[32106](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:51 dist-test-slave-jlzn krb5kdc[32106](info): set up 2 sockets
Aug 09 02:24:51 dist-test-slave-jlzn krb5kdc[32106](info): commencing operation
krb5kdc: starting...
W20260809 02:24:52.897073 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:52 dist-test-slave-jlzn krb5kdc[32106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:24:53.014253 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46465
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:53.120425 32125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:53.120657 32125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:53.120713 32125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:53.124595 32125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:53.124646 32125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:53.124672 32125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:53.124694 32125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:53.124722 32125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:53.129649 32125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46465
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:53.130503 32125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:53.131381 32125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:53.139171 32131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:53.139153 32135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:53.139142 32130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:53.139350 32125 server_base.cc:1034] running on GCE node
I20260809 02:24:53.139999 32125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:53.140964 32125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:53.142133 32125 hybrid_clock.cc:648] HybridClock initialized: now 1786242293142107 us; error 41 us; skew 500 ppm
Aug 09 02:24:53 dist-test-slave-jlzn krb5kdc[32106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242293, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:53.144728 32125 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:24:53.145483 32125 webserver.cc:460] Webserver started at http://127.0.0.1:40149/ using document root <none> and password file <none>
I20260809 02:24:53.145947 32125 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:53.146004 32125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:53.146195 32125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:53.148039 32125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "1b556391b2044cc4adb3e3375e555dbc"
format_stamp: "Formatted at 2026-08-09 02:24:53 on dist-test-slave-jlzn"
server_key: "094e5274990a712aaaec43106c346fa5"
server_key_iv: "06158634b94ae60a6033bf765e7baa88"
server_key_version: "encryptionkey@0"
I20260809 02:24:53.148548 32125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "1b556391b2044cc4adb3e3375e555dbc"
format_stamp: "Formatted at 2026-08-09 02:24:53 on dist-test-slave-jlzn"
server_key: "094e5274990a712aaaec43106c346fa5"
server_key_iv: "06158634b94ae60a6033bf765e7baa88"
server_key_version: "encryptionkey@0"
I20260809 02:24:53.151793 32125 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:24:53.153966 32146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:53.155017 32125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:24:53.155117 32125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "1b556391b2044cc4adb3e3375e555dbc"
format_stamp: "Formatted at 2026-08-09 02:24:53 on dist-test-slave-jlzn"
server_key: "094e5274990a712aaaec43106c346fa5"
server_key_iv: "06158634b94ae60a6033bf765e7baa88"
server_key_version: "encryptionkey@0"
I20260809 02:24:53.155215 32125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:53.172531 32125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:53.174932 32125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:53.175081 32125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:53.181432 32125 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46465
I20260809 02:24:53.181488 32230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46465 every 8 connection(s)
I20260809 02:24:53.182248 32125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:53.184765 32231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:53.189096 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 32125
I20260809 02:24:53.189214 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:53.189464 1351 external_mini_cluster.cc:1428] Setting key 2364785eb3205b0080c6693a461e458f
I20260809 02:24:53.189909 32231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc: Bootstrap starting.
I20260809 02:24:53.192162 32231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:53.192955 32231 log.cc:824] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:53.194886 32231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc: No bootstrap required, opened a new log
I20260809 02:24:53.197657 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:53.190615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34747 (local address 127.0.0.1:46465)
0809 02:24:53.190981 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:53.190995 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:53.191027 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:24:53.191655 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:53.191673 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:53.192032 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:53.192326 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:53.192642 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:53.193625 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:53.194753 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:53.195218 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:53.195328 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:53.196149 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:53.196154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:53.196165 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:53.196508 (+ 343us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:53.196568 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:53.196590 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:53.196694 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:53.196871 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:24:53.196990 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":90,"threads_started":1}
I20260809 02:24:53.198583 32231 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b556391b2044cc4adb3e3375e555dbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46465 } }
I20260809 02:24:53.198830 32231 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:53.198889 32231 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b556391b2044cc4adb3e3375e555dbc, State: Initialized, Role: FOLLOWER
I20260809 02:24:53.199299 32231 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b556391b2044cc4adb3e3375e555dbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46465 } }
I20260809 02:24:53.199430 32231 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:53.199493 32231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:53.199589 32231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:53.200412 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:24:53.200529 32231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b556391b2044cc4adb3e3375e555dbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46465 } }
I20260809 02:24:53.200829 32231 leader_election.cc:302] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b556391b2044cc4adb3e3375e555dbc; no voters:
I20260809 02:24:53.201092 32231 leader_election.cc:288] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:53.201189 32237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:53.201396 32237 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [term 1 LEADER]: Becoming Leader. State: Replica: 1b556391b2044cc4adb3e3375e555dbc, State: Running, Role: LEADER
I20260809 02:24:53.201711 32237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b556391b2044cc4adb3e3375e555dbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46465 } }
I20260809 02:24:53.202193 32231 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:53.202862 32237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b556391b2044cc4adb3e3375e555dbc. Latest consensus state: current_term: 1 leader_uuid: "1b556391b2044cc4adb3e3375e555dbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b556391b2044cc4adb3e3375e555dbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46465 } } }
I20260809 02:24:53.202977 32237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:53.203253 32238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b556391b2044cc4adb3e3375e555dbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b556391b2044cc4adb3e3375e555dbc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46465 } } }
I20260809 02:24:53.203356 32238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:53.203755 32254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:53.206755 32254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:53.207546 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:53.202419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35517 (local address 127.0.0.1:46465)
0809 02:24:53.202524 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:53.202528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:53.202905 (+ 377us) server_negotiation.cc:407] Connection header received
0809 02:24:53.203080 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:53.203083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:53.203126 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:53.203173 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:53.203507 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:53.204250 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:53.205370 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:53.205688 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:53.205778 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:53.206714 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:53.206717 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:53.206720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:53.206732 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:53.206757 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:53.206769 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:53.206875 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:53.207398 (+ 523us) server_negotiation.cc:299] Negotiation successful
0809 02:24:53.207431 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:24:53.215306 32254 catalog_manager.cc:1347] Generated new cluster ID: c4273d80ec484ba385d3e14742a610ad
I20260809 02:24:53.215360 32254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:53.223701 32254 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:53.224455 32254 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:53.239235 32254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b556391b2044cc4adb3e3375e555dbc: Generated new TSK 0
I20260809 02:24:53.239904 32254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:53.247820 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 32125
W20260809 02:24:53.262799 32104 connection.cc:535] client connection to 127.0.0.1:46465 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46465): Connection reset by peer (error 104)
2026-08-09T02:24:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1484 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:53 dist-test-slave-jlzn krb5kdc[32273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:53 dist-test-slave-jlzn krb5kdc[32273](info): set up 2 sockets
Aug 09 02:24:53 dist-test-slave-jlzn krb5kdc[32273](info): commencing operation
krb5kdc: starting...
W20260809 02:24:54.374871 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:54 dist-test-slave-jlzn krb5kdc[32273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:24:54.486337 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:54.592154 32291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:54.592381 32291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:54.592437 32291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:54.596282 32291 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:54.596333 32291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:54.596359 32291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:54.596386 32291 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:54.596415 32291 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:54.601325 32291 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43265
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:54.602170 32291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:54.603039 32291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:54.610862 32301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:54.610968 32291 server_base.cc:1034] running on GCE node
W20260809 02:24:54.610893 32302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:54.610883 32305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:54.611622 32291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:54.612589 32291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:54.613752 32291 hybrid_clock.cc:648] HybridClock initialized: now 1786242294613733 us; error 30 us; skew 500 ppm
Aug 09 02:24:54 dist-test-slave-jlzn krb5kdc[32273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242294, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:54.618932 32291 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:24:54.619732 32291 webserver.cc:460] Webserver started at http://127.0.0.1:35401/ using document root <none> and password file <none>
I20260809 02:24:54.620231 32291 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:54.620297 32291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:54.620472 32291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:54.622298 32291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "f9470d6cd4ff4c5e9ff084b345ad955b"
format_stamp: "Formatted at 2026-08-09 02:24:54 on dist-test-slave-jlzn"
server_key: "e53cc160eeb43bf1b4fac1b38d60c462"
server_key_iv: "828405611cfe81d28f7ef4b197b32dfe"
server_key_version: "encryptionkey@0"
I20260809 02:24:54.622812 32291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "f9470d6cd4ff4c5e9ff084b345ad955b"
format_stamp: "Formatted at 2026-08-09 02:24:54 on dist-test-slave-jlzn"
server_key: "e53cc160eeb43bf1b4fac1b38d60c462"
server_key_iv: "828405611cfe81d28f7ef4b197b32dfe"
server_key_version: "encryptionkey@0"
I20260809 02:24:54.626135 32291 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:24:54.628336 32319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:54.629396 32291 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:24:54.629509 32291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "f9470d6cd4ff4c5e9ff084b345ad955b"
format_stamp: "Formatted at 2026-08-09 02:24:54 on dist-test-slave-jlzn"
server_key: "e53cc160eeb43bf1b4fac1b38d60c462"
server_key_iv: "828405611cfe81d28f7ef4b197b32dfe"
server_key_version: "encryptionkey@0"
I20260809 02:24:54.629595 32291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:54.633798 32291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:54.636526 32291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:54.636684 32291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:54.643167 32291 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43265
I20260809 02:24:54.643183 32401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43265 every 8 connection(s)
I20260809 02:24:54.643970 32291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:54.646404 32402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:54.651039 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 32291
I20260809 02:24:54.651173 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:54.651482 1351 external_mini_cluster.cc:1428] Setting key cf16eb4ac49e11db9ed0eb99a74aee48
I20260809 02:24:54.651525 32402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b: Bootstrap starting.
I20260809 02:24:54.653825 32402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:54.654610 32402 log.cc:824] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:54.656118 32410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:54.652684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44939 (local address 127.0.0.1:43265)
0809 02:24:54.653077 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:54.653090 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:54.653123 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:24:54.653705 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:54.653720 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:54.653990 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:54.654249 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:54.654992 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:54.654998 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:54.655013 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:54.655026 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:54.655087 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:54.655115 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:54.655239 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:54.655323 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 02:24:54.655468 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":111,"threads_started":1}
I20260809 02:24:54.656494 32402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b: No bootstrap required, opened a new log
I20260809 02:24:54.658613 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:24:54.660674 32402 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9470d6cd4ff4c5e9ff084b345ad955b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43265 } }
I20260809 02:24:54.660908 32402 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:54.660974 32402 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9470d6cd4ff4c5e9ff084b345ad955b, State: Initialized, Role: FOLLOWER
I20260809 02:24:54.661418 32402 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9470d6cd4ff4c5e9ff084b345ad955b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43265 } }
I20260809 02:24:54.661584 32402 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:54.661653 32402 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:54.661755 32402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:54.662257 32410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:54.660806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56283 (local address 127.0.0.1:43265)
0809 02:24:54.660920 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:54.660923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:54.661049 (+ 126us) server_negotiation.cc:407] Connection header received
0809 02:24:54.661169 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:54.661171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:54.661204 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:54.661278 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:54.661929 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:54.661932 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:54.661934 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:54.661945 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:54.661968 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:54.661977 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:54.662042 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:54.662153 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 02:24:54.662179 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:24:54.662734 32402 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9470d6cd4ff4c5e9ff084b345ad955b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43265 } }
I20260809 02:24:54.663067 32402 leader_election.cc:302] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9470d6cd4ff4c5e9ff084b345ad955b; no voters:
I20260809 02:24:54.663398 32402 leader_election.cc:288] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:54.663456 32420 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:54.663655 32420 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [term 1 LEADER]: Becoming Leader. State: Replica: f9470d6cd4ff4c5e9ff084b345ad955b, State: Running, Role: LEADER
I20260809 02:24:54.663959 32420 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9470d6cd4ff4c5e9ff084b345ad955b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43265 } }
I20260809 02:24:54.664474 32402 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:54.665447 32423 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9470d6cd4ff4c5e9ff084b345ad955b. Latest consensus state: current_term: 1 leader_uuid: "f9470d6cd4ff4c5e9ff084b345ad955b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9470d6cd4ff4c5e9ff084b345ad955b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43265 } } }
I20260809 02:24:54.665572 32423 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:54.665836 32422 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9470d6cd4ff4c5e9ff084b345ad955b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9470d6cd4ff4c5e9ff084b345ad955b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43265 } } }
I20260809 02:24:54.665892 32434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:54.665943 32422 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:54.668747 32434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:54.674515 32434 catalog_manager.cc:1347] Generated new cluster ID: 040a41ba7e474e928e92e518fb8a09f3
I20260809 02:24:54.674564 32434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:54.690877 32434 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:54.691167 32434 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:54.696440 32434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9470d6cd4ff4c5e9ff084b345ad955b: Generated new TSK 0
I20260809 02:24:54.697074 32434 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:54.701830 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 32291
2026-08-09T02:24:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1451 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:54 dist-test-slave-jlzn krb5kdc[32449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:54 dist-test-slave-jlzn krb5kdc[32449](info): set up 2 sockets
Aug 09 02:24:54 dist-test-slave-jlzn krb5kdc[32449](info): commencing operation
krb5kdc: starting...
W20260809 02:24:55.829492 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:55 dist-test-slave-jlzn krb5kdc[32449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:24:55.940428 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41267
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41267
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:56.046626 32471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:56.046846 32471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:56.046892 32471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:56.050756 32471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:56.050804 32471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:56.050824 32471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:56.050855 32471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:56.050881 32471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:56.055896 32471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:56.056756 32471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:56.057646 32471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:56.065551 32476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:56.065577 32477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:56.065804 32471 server_base.cc:1034] running on GCE node
W20260809 02:24:56.065863 32480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:56.066550 32471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:56.067685 32471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:56.068846 32471 hybrid_clock.cc:648] HybridClock initialized: now 1786242296068829 us; error 28 us; skew 500 ppm
Aug 09 02:24:56 dist-test-slave-jlzn krb5kdc[32449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242296, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:56.071341 32471 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:24:56.072166 32471 webserver.cc:460] Webserver started at http://127.0.0.1:34493/ using document root <none> and password file <none>
I20260809 02:24:56.072650 32471 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:56.072714 32471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:56.072889 32471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:56.074710 32471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "51599e748e4f4298951a35b4f5748be8"
format_stamp: "Formatted at 2026-08-09 02:24:56 on dist-test-slave-jlzn"
server_key: "d6ea7ddc16865e67e69964a1b42323cc"
server_key_iv: "1fae9a587a946e92f5e6ed5bfbb123be"
server_key_version: "encryptionkey@0"
I20260809 02:24:56.075232 32471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "51599e748e4f4298951a35b4f5748be8"
format_stamp: "Formatted at 2026-08-09 02:24:56 on dist-test-slave-jlzn"
server_key: "d6ea7ddc16865e67e69964a1b42323cc"
server_key_iv: "1fae9a587a946e92f5e6ed5bfbb123be"
server_key_version: "encryptionkey@0"
I20260809 02:24:56.078537 32471 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:24:56.080757 32492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:56.081843 32471 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:56.081954 32471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "51599e748e4f4298951a35b4f5748be8"
format_stamp: "Formatted at 2026-08-09 02:24:56 on dist-test-slave-jlzn"
server_key: "d6ea7ddc16865e67e69964a1b42323cc"
server_key_iv: "1fae9a587a946e92f5e6ed5bfbb123be"
server_key_version: "encryptionkey@0"
I20260809 02:24:56.082043 32471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:56.102198 32471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:56.105033 32471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:56.105194 32471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:56.111589 32471 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41267
I20260809 02:24:56.111637 32569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41267 every 8 connection(s)
I20260809 02:24:56.112493 32471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:56.115016 32570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:56.115455 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 32471
I20260809 02:24:56.115599 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:56.115954 1351 external_mini_cluster.cc:1428] Setting key fcc057f63cac744dccb34e8b9e0909e6
I20260809 02:24:56.121820 32570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8: Bootstrap starting.
I20260809 02:24:56.124356 32570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8: Neither blocks nor log segments found. Creating new log.
Aug 09 02:24:56 dist-test-slave-jlzn krb5kdc[32449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:24:56.125092 32570 log.cc:824] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:56.127182 32570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8: No bootstrap required, opened a new log
I20260809 02:24:56.129640 32573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:56.117199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33541 (local address 127.0.0.1:41267)
0809 02:24:56.117584 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:56.117598 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:56.117632 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:24:56.118290 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:56.118307 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:56.118605 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:56.118866 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:56.119772 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:56.120750 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:56.121891 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:56.122351 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:56.122470 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:56.125022 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:56.125028 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:56.125052 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:56.125083 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:56.126628 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:56.127121 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:56.127126 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:56.127130 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:56.127238 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:56.127522 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:56.127526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:56.127528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:56.128042 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:56.128235 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:56.128450 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 02:24:56.128726 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":112,"threads_started":1}
I20260809 02:24:56.131379 32570 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51599e748e4f4298951a35b4f5748be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41267 } }
I20260809 02:24:56.131647 32570 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:56.131721 32570 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51599e748e4f4298951a35b4f5748be8, State: Initialized, Role: FOLLOWER
I20260809 02:24:56.132169 32570 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51599e748e4f4298951a35b4f5748be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41267 } }
I20260809 02:24:56.132324 32570 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:56.132359 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:24:56.132391 32570 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:56.132494 32570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:56.133270 32570 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51599e748e4f4298951a35b4f5748be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41267 } }
I20260809 02:24:56.133589 32570 leader_election.cc:302] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51599e748e4f4298951a35b4f5748be8; no voters:
I20260809 02:24:56.133884 32570 leader_election.cc:288] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:56.133991 32581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:56.134204 32581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [term 1 LEADER]: Becoming Leader. State: Replica: 51599e748e4f4298951a35b4f5748be8, State: Running, Role: LEADER
I20260809 02:24:56.134567 32581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51599e748e4f4298951a35b4f5748be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41267 } }
I20260809 02:24:56.134963 32570 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:56.135560 32581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51599e748e4f4298951a35b4f5748be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51599e748e4f4298951a35b4f5748be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41267 } } }
I20260809 02:24:56.135676 32581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:56.135952 32581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51599e748e4f4298951a35b4f5748be8. Latest consensus state: current_term: 1 leader_uuid: "51599e748e4f4298951a35b4f5748be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51599e748e4f4298951a35b4f5748be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41267 } } }
I20260809 02:24:56.136044 32581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8 [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:56.136297 32597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:56.138820 32597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:56.145004 32597 catalog_manager.cc:1347] Generated new cluster ID: e1c50dc30cb9447982f69b8d958f6b79
I20260809 02:24:56.145293 32597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:56.148285 32573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:56.134268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51361 (local address 127.0.0.1:41267)
0809 02:24:56.134366 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:56.134369 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:56.140092 (+ 5723us) server_negotiation.cc:407] Connection header received
0809 02:24:56.140202 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:56.140205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:56.140251 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:56.140332 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:56.141224 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:56.141948 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:56.143060 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:56.143297 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:56.143373 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:56.144866 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:56.144870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:56.144872 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:24:56.144906 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:56.146419 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:56.146902 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:56.146906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:56.146908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:56.146995 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:24:56.147320 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:24:56.147324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:24:56.147325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:24:56.147524 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:56.147622 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:56.148014 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 02:24:56.148138 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:24:56.165983 32597 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:56.166760 32597 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:56.174057 32597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51599e748e4f4298951a35b4f5748be8: Generated new TSK 0
I20260809 02:24:56.174592 32597 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:56.181383 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 32471
2026-08-09T02:24:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:56 dist-test-slave-jlzn krb5kdc[32619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:56 dist-test-slave-jlzn krb5kdc[32619](info): set up 2 sockets
Aug 09 02:24:56 dist-test-slave-jlzn krb5kdc[32619](info): commencing operation
krb5kdc: starting...
W20260809 02:24:57.306660 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:57 dist-test-slave-jlzn krb5kdc[32619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:24:57.415890 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35769
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:57.520928 32642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:57.521152 32642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:57.521195 32642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:57.525013 32642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:57.525061 32642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:57.525079 32642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:57.525106 32642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:57.525133 32642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:57.530026 32642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:57.530885 32642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:57.531793 32642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:57.539616 32649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:57.539588 32648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:57.539670 32642 server_base.cc:1034] running on GCE node
W20260809 02:24:57.539616 32651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:57.540345 32642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:57.541358 32642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:57.542503 32642 hybrid_clock.cc:648] HybridClock initialized: now 1786242297542485 us; error 31 us; skew 500 ppm
Aug 09 02:24:57 dist-test-slave-jlzn krb5kdc[32619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242297, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:57.545037 32642 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:24:57.545828 32642 webserver.cc:460] Webserver started at http://127.0.0.1:36077/ using document root <none> and password file <none>
I20260809 02:24:57.546312 32642 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:57.546375 32642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:57.546545 32642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:57.548414 32642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "01c79cdf4a5e4745954d5f61d75e345f"
format_stamp: "Formatted at 2026-08-09 02:24:57 on dist-test-slave-jlzn"
server_key: "04af53b382cdf8300600c84b50655a87"
server_key_iv: "256be5eaa828d3b73357b96b979bbf83"
server_key_version: "encryptionkey@0"
I20260809 02:24:57.548915 32642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "01c79cdf4a5e4745954d5f61d75e345f"
format_stamp: "Formatted at 2026-08-09 02:24:57 on dist-test-slave-jlzn"
server_key: "04af53b382cdf8300600c84b50655a87"
server_key_iv: "256be5eaa828d3b73357b96b979bbf83"
server_key_version: "encryptionkey@0"
I20260809 02:24:57.552217 32642 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:24:57.554324 32660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:57.555353 32642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:57.555461 32642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "01c79cdf4a5e4745954d5f61d75e345f"
format_stamp: "Formatted at 2026-08-09 02:24:57 on dist-test-slave-jlzn"
server_key: "04af53b382cdf8300600c84b50655a87"
server_key_iv: "256be5eaa828d3b73357b96b979bbf83"
server_key_version: "encryptionkey@0"
I20260809 02:24:57.555547 32642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:57.570168 32642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:57.572893 32642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:57.573052 32642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:57.579380 32642 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35769
I20260809 02:24:57.579401 32737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35769 every 8 connection(s)
I20260809 02:24:57.580199 32642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:57.580699 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 32642
I20260809 02:24:57.580843 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:57.581089 1351 external_mini_cluster.cc:1428] Setting key 2e857999a8e7d21a2c2ae2617a4f70ad
I20260809 02:24:57.583002 32738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:57.588831 32738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f: Bootstrap starting.
I20260809 02:24:57.589359 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:57.582333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49975 (local address 127.0.0.1:35769)
0809 02:24:57.582736 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:57.582750 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:57.582783 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:24:57.583373 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:57.583390 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:57.583702 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:57.583996 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:57.584352 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:57.585308 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:57.586504 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:57.586933 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:57.587039 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:57.587791 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:57.587796 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:57.587840 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:57.588182 (+ 342us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:57.588233 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:57.588256 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:57.588330 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:57.588480 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 02:24:57.588667 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":108,"threads_started":1}
I20260809 02:24:57.590835 32738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:57.591580 32738 log.cc:824] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:57.591749 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:24:57.593312 32738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f: No bootstrap required, opened a new log
I20260809 02:24:57.596664 32738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c79cdf4a5e4745954d5f61d75e345f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35769 } }
I20260809 02:24:57.596869 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:57.593539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36419 (local address 127.0.0.1:35769)
0809 02:24:57.593632 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:57.593636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:57.593816 (+ 180us) server_negotiation.cc:407] Connection header received
0809 02:24:57.593913 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:57.593916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:57.593954 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:57.594016 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:57.594256 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:57.594794 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:57.595542 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:24:57.595758 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:24:57.595861 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:24:57.596511 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:57.596515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:57.596517 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:57.596528 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:57.596550 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:57.596560 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:57.596613 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:57.596711 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 02:24:57.596755 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:24:57.596908 32738 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:57.596964 32738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01c79cdf4a5e4745954d5f61d75e345f, State: Initialized, Role: FOLLOWER
I20260809 02:24:57.597361 32738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c79cdf4a5e4745954d5f61d75e345f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35769 } }
I20260809 02:24:57.597520 32738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:57.597590 32738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:57.597697 32738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:57.598443 32738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c79cdf4a5e4745954d5f61d75e345f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35769 } }
I20260809 02:24:57.598722 32738 leader_election.cc:302] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01c79cdf4a5e4745954d5f61d75e345f; no voters:
I20260809 02:24:57.598943 32738 leader_election.cc:288] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:57.599042 32751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:57.599243 32751 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [term 1 LEADER]: Becoming Leader. State: Replica: 01c79cdf4a5e4745954d5f61d75e345f, State: Running, Role: LEADER
I20260809 02:24:57.599560 32751 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c79cdf4a5e4745954d5f61d75e345f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35769 } }
I20260809 02:24:57.600001 32738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:57.601033 32753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01c79cdf4a5e4745954d5f61d75e345f. Latest consensus state: current_term: 1 leader_uuid: "01c79cdf4a5e4745954d5f61d75e345f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c79cdf4a5e4745954d5f61d75e345f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35769 } } }
I20260809 02:24:57.601141 32753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:57.601438 32752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01c79cdf4a5e4745954d5f61d75e345f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01c79cdf4a5e4745954d5f61d75e345f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35769 } } }
I20260809 02:24:57.601563 32752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:57.601531 32764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:57.604843 32764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:57.609503 32764 catalog_manager.cc:1347] Generated new cluster ID: 542fde3c0ea64d50a732a705bc84141b
I20260809 02:24:57.609563 32764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:57.615576 32764 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:57.616392 32764 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:57.623742 32764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01c79cdf4a5e4745954d5f61d75e345f: Generated new TSK 0
I20260809 02:24:57.624303 32764 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:57.632871 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 32642
2026-08-09T02:24:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1448 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:57 dist-test-slave-jlzn krb5kdc[316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:57 dist-test-slave-jlzn krb5kdc[316](info): set up 2 sockets
Aug 09 02:24:57 dist-test-slave-jlzn krb5kdc[316](info): commencing operation
krb5kdc: starting...
W20260809 02:24:58.748591 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:24:58 dist-test-slave-jlzn krb5kdc[316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:24:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:24:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:24:58.860563 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37235
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37235
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:24:58.967711 332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:24:58.967971 332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:24:58.968015 332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:24:58.971791 332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:24:58.971853 332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:24:58.971870 332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:24:58.971890 332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:24:58.971904 332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:24:58.976727 332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:24:58.977520 332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:24:58.978364 332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:24:58.986132 342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:58.986167 338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:24:58.987210 339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:24:58.987672 332 server_base.cc:1034] running on GCE node
I20260809 02:24:58.988178 332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:24:58.989127 332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:24:58.990274 332 hybrid_clock.cc:648] HybridClock initialized: now 1786242298990256 us; error 32 us; skew 500 ppm
Aug 09 02:24:58 dist-test-slave-jlzn krb5kdc[316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242298, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:24:58.992782 332 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:24:58.993577 332 webserver.cc:460] Webserver started at http://127.0.0.1:33593/ using document root <none> and password file <none>
I20260809 02:24:58.994061 332 fs_manager.cc:359] Metadata directory not provided
I20260809 02:24:58.994127 332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:24:58.994297 332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:24:58.996152 332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "96a9b96bf5434b118a0fb95eacfd001d"
format_stamp: "Formatted at 2026-08-09 02:24:58 on dist-test-slave-jlzn"
server_key: "e3af93ee17620b0d7d717e919c4500f3"
server_key_iv: "6643e18a12358cc94039b270991ece61"
server_key_version: "encryptionkey@0"
I20260809 02:24:58.996667 332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "96a9b96bf5434b118a0fb95eacfd001d"
format_stamp: "Formatted at 2026-08-09 02:24:58 on dist-test-slave-jlzn"
server_key: "e3af93ee17620b0d7d717e919c4500f3"
server_key_iv: "6643e18a12358cc94039b270991ece61"
server_key_version: "encryptionkey@0"
I20260809 02:24:58.999956 332 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:24:59.002069 357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:24:59.003103 332 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:24:59.003214 332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "96a9b96bf5434b118a0fb95eacfd001d"
format_stamp: "Formatted at 2026-08-09 02:24:58 on dist-test-slave-jlzn"
server_key: "e3af93ee17620b0d7d717e919c4500f3"
server_key_iv: "6643e18a12358cc94039b270991ece61"
server_key_version: "encryptionkey@0"
I20260809 02:24:59.003307 332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:24:59.007376 332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:24:59.009802 332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:24:59.009961 332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:24:59.016392 332 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37235
I20260809 02:24:59.016403 435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37235 every 8 connection(s)
I20260809 02:24:59.017179 332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:24:59.019613 440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:24:59.024533 440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d: Bootstrap starting.
I20260809 02:24:59.025234 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 332
I20260809 02:24:59.025360 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:24:59.025591 1351 external_mini_cluster.cc:1428] Setting key c985b9c43d482127575b54bbb66f2ad9
I20260809 02:24:59.026969 440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d: Neither blocks nor log segments found. Creating new log.
I20260809 02:24:59.027653 440 log.cc:824] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:24:59.029703 440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d: No bootstrap required, opened a new log
I20260809 02:24:59.030088 445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:59.026543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57631 (local address 127.0.0.1:37235)
0809 02:24:59.026935 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:59.026948 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:59.026980 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:24:59.027586 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:59.027601 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:59.027905 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:59.028166 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:59.028827 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:59.028833 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:59.028845 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:59.028857 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:59.028916 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:59.028943 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:59.029051 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:59.029117 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 02:24:59.029260 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":108,"threads_started":1}
I20260809 02:24:59.032735 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:24:59.033555 440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a9b96bf5434b118a0fb95eacfd001d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37235 } }
I20260809 02:24:59.033756 440 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:24:59.033830 440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a9b96bf5434b118a0fb95eacfd001d, State: Initialized, Role: FOLLOWER
I20260809 02:24:59.034283 440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a9b96bf5434b118a0fb95eacfd001d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37235 } }
I20260809 02:24:59.034410 440 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:24:59.034492 440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:24:59.034600 440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:24:59.035647 440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a9b96bf5434b118a0fb95eacfd001d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37235 } }
I20260809 02:24:59.036032 440 leader_election.cc:302] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96a9b96bf5434b118a0fb95eacfd001d; no voters:
I20260809 02:24:59.036155 445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:24:59.034581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46643 (local address 127.0.0.1:37235)
0809 02:24:59.034685 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:24:59.034689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:24:59.034932 (+ 243us) server_negotiation.cc:407] Connection header received
0809 02:24:59.035039 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:24:59.035041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:24:59.035067 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:24:59.035127 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:24:59.035735 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:24:59.035737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:24:59.035739 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:24:59.035749 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:24:59.035773 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:24:59.035785 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:24:59.035879 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:24:59.035972 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 02:24:59.035999 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 02:24:59.036412 440 leader_election.cc:288] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:24:59.036485 456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:24:59.036693 456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [term 1 LEADER]: Becoming Leader. State: Replica: 96a9b96bf5434b118a0fb95eacfd001d, State: Running, Role: LEADER
I20260809 02:24:59.037014 456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a9b96bf5434b118a0fb95eacfd001d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37235 } }
I20260809 02:24:59.037554 440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:24:59.038020 463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96a9b96bf5434b118a0fb95eacfd001d. Latest consensus state: current_term: 1 leader_uuid: "96a9b96bf5434b118a0fb95eacfd001d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a9b96bf5434b118a0fb95eacfd001d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37235 } } }
I20260809 02:24:59.038209 463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:59.039089 468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:24:59.039108 460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96a9b96bf5434b118a0fb95eacfd001d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a9b96bf5434b118a0fb95eacfd001d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37235 } } }
I20260809 02:24:59.039252 460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d [sys.catalog]: This master's current role is: LEADER
I20260809 02:24:59.042039 468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:24:59.046890 468 catalog_manager.cc:1347] Generated new cluster ID: e180ce2613e64c768c7bd907852cc055
I20260809 02:24:59.046955 468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:24:59.066255 468 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:24:59.066529 468 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:24:59.073879 468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96a9b96bf5434b118a0fb95eacfd001d: Generated new TSK 0
I20260809 02:24:59.074503 468 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:24:59.087392 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 332
2026-08-09T02:24:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:24:59 dist-test-slave-jlzn krb5kdc[494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:24:59 dist-test-slave-jlzn krb5kdc[494](info): set up 2 sockets
Aug 09 02:24:59 dist-test-slave-jlzn krb5kdc[494](info): commencing operation
krb5kdc: starting...
W20260809 02:25:00.220420 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:00 dist-test-slave-jlzn krb5kdc[494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:25:00.330247 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36849
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:00.434595 511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:00.434820 511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:00.434873 511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:00.438696 511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:00.438746 511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:00.438772 511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:00.438793 511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:00.438820 511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:00.443835 511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:00.444810 511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:00.445708 511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:00.453585 511 server_base.cc:1034] running on GCE node
W20260809 02:25:00.453552 517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:00.453569 520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:00.453550 522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:00.454387 511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:00.455351 511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:00.456504 511 hybrid_clock.cc:648] HybridClock initialized: now 1786242300456485 us; error 29 us; skew 500 ppm
Aug 09 02:25:00 dist-test-slave-jlzn krb5kdc[494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242300, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:00.462627 511 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:25:00.463387 511 webserver.cc:460] Webserver started at http://127.0.0.1:36367/ using document root <none> and password file <none>
I20260809 02:25:00.463905 511 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:00.463970 511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:00.464133 511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:00.465977 511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "a6477c9664ab4fe38667bd9a8441a7fd"
format_stamp: "Formatted at 2026-08-09 02:25:00 on dist-test-slave-jlzn"
server_key: "a53b0f814f5e5fbee7d520d40c986aca"
server_key_iv: "72994ac12236995cc97420927416a6eb"
server_key_version: "encryptionkey@0"
I20260809 02:25:00.466460 511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "a6477c9664ab4fe38667bd9a8441a7fd"
format_stamp: "Formatted at 2026-08-09 02:25:00 on dist-test-slave-jlzn"
server_key: "a53b0f814f5e5fbee7d520d40c986aca"
server_key_iv: "72994ac12236995cc97420927416a6eb"
server_key_version: "encryptionkey@0"
I20260809 02:25:00.469813 511 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:25:00.471972 534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:00.473039 511 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:00.473151 511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "a6477c9664ab4fe38667bd9a8441a7fd"
format_stamp: "Formatted at 2026-08-09 02:25:00 on dist-test-slave-jlzn"
server_key: "a53b0f814f5e5fbee7d520d40c986aca"
server_key_iv: "72994ac12236995cc97420927416a6eb"
server_key_version: "encryptionkey@0"
I20260809 02:25:00.473240 511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:00.500027 511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:00.502419 511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:00.502580 511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:00.509182 511 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36849
I20260809 02:25:00.509202 617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36849 every 8 connection(s)
I20260809 02:25:00.510006 511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:00.512563 618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:00.515165 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 511
I20260809 02:25:00.515276 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:00.515514 1351 external_mini_cluster.cc:1428] Setting key 8f1125ab65747594cdff0afe26b240e0
I20260809 02:25:00.517876 618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd: Bootstrap starting.
I20260809 02:25:00.520226 618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:00.521103 618 log.cc:824] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:00.523130 618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd: No bootstrap required, opened a new log
Aug 09 02:25:00 dist-test-slave-jlzn krb5kdc[494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:25:00.526432 618 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6477c9664ab4fe38667bd9a8441a7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260809 02:25:00.526686 618 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:00.526747 618 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6477c9664ab4fe38667bd9a8441a7fd, State: Initialized, Role: FOLLOWER
I20260809 02:25:00.527180 618 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6477c9664ab4fe38667bd9a8441a7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260809 02:25:00.527349 618 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:00.527415 618 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:00.527521 618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:00.528448 618 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6477c9664ab4fe38667bd9a8441a7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260809 02:25:00.528815 618 leader_election.cc:302] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6477c9664ab4fe38667bd9a8441a7fd; no voters:
I20260809 02:25:00.529132 618 leader_election.cc:288] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:00.529232 624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:00.529402 624 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [term 1 LEADER]: Becoming Leader. State: Replica: a6477c9664ab4fe38667bd9a8441a7fd, State: Running, Role: LEADER
I20260809 02:25:00.529708 624 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6477c9664ab4fe38667bd9a8441a7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260809 02:25:00.530004 622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:00.516703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:56305 (local address 127.0.0.1:36849)
0809 02:25:00.517075 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:00.517090 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:00.517124 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:25:00.517720 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:00.517735 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:00.518056 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:00.518314 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:00.519177 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:00.520198 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:00.521345 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:00.521951 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:00.522074 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:00.524782 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:00.524787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:00.524798 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:00.524824 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:00.526951 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:00.527521 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:00.527527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:00.527533 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:00.527682 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:00.528024 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:00.528026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:00.528027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:00.528372 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:00.528534 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:00.528853 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 02:25:00.529062 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":108,"threads_started":1}
I20260809 02:25:00.530319 618 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:00.531389 626 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6477c9664ab4fe38667bd9a8441a7fd. Latest consensus state: current_term: 1 leader_uuid: "a6477c9664ab4fe38667bd9a8441a7fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6477c9664ab4fe38667bd9a8441a7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } } }
I20260809 02:25:00.531517 626 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:00.531970 634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:00.532096 625 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6477c9664ab4fe38667bd9a8441a7fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6477c9664ab4fe38667bd9a8441a7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } } }
I20260809 02:25:00.532212 625 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:00.532970 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:00.535028 634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:00.541126 634 catalog_manager.cc:1347] Generated new cluster ID: e07fe39a246f42c39d5e2472c8d0b1ba
I20260809 02:25:00.541193 634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:00.544509 622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:00.535429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:45117 (local address 127.0.0.1:36849)
0809 02:25:00.535515 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:00.535520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:00.536530 (+ 1010us) server_negotiation.cc:407] Connection header received
0809 02:25:00.536624 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:00.536627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:00.536675 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:00.536757 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:00.537497 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:00.537991 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:00.538762 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:00.539010 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:00.539099 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:00.540921 (+ 1822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:00.540925 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:00.540927 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:00.540952 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:00.542785 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:00.543271 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:00.543275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:00.543276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:00.543362 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:00.543646 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:00.543650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:00.543652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:00.543896 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:00.544052 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:00.544268 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 02:25:00.544363 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:25:00.562024 634 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:00.563100 634 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:00.576177 634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6477c9664ab4fe38667bd9a8441a7fd: Generated new TSK 0
I20260809 02:25:00.576771 634 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:00.580679 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 511
W20260809 02:25:00.593947 492 connection.cc:535] client connection to 127.0.0.1:36849 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36849): Connection reset by peer (error 104)
2026-08-09T02:25:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1499 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:00 dist-test-slave-jlzn krb5kdc[664](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:00 dist-test-slave-jlzn krb5kdc[664](info): set up 2 sockets
Aug 09 02:25:00 dist-test-slave-jlzn krb5kdc[664](info): commencing operation
krb5kdc: starting...
W20260809 02:25:01.697192 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:01 dist-test-slave-jlzn krb5kdc[664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:25:01.808708 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41809
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:01.914288 680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:01.914523 680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:01.914579 680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:01.918458 680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:01.918511 680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:01.918538 680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:01.918560 680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:01.918587 680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:01.923491 680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:01.924403 680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:01.925292 680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:01.933034 690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:01.933082 693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:01.933184 680 server_base.cc:1034] running on GCE node
W20260809 02:25:01.933028 696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:01.933894 680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:01.934830 680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:01.935971 680 hybrid_clock.cc:648] HybridClock initialized: now 1786242301935951 us; error 32 us; skew 500 ppm
Aug 09 02:25:01 dist-test-slave-jlzn krb5kdc[664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242301, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:01.938429 680 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:25:01.939185 680 webserver.cc:460] Webserver started at http://127.0.0.1:37871/ using document root <none> and password file <none>
I20260809 02:25:01.939631 680 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:01.939695 680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:01.939882 680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:01.941671 680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "200d41b2cb2346c598c25d0a8746f414"
format_stamp: "Formatted at 2026-08-09 02:25:01 on dist-test-slave-jlzn"
server_key: "e2d2c39095974ce80cbef2159e394557"
server_key_iv: "d0ae1087bb623b4fc7f89e0edf8057ef"
server_key_version: "encryptionkey@0"
I20260809 02:25:01.942142 680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "200d41b2cb2346c598c25d0a8746f414"
format_stamp: "Formatted at 2026-08-09 02:25:01 on dist-test-slave-jlzn"
server_key: "e2d2c39095974ce80cbef2159e394557"
server_key_iv: "d0ae1087bb623b4fc7f89e0edf8057ef"
server_key_version: "encryptionkey@0"
I20260809 02:25:01.945456 680 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:25:01.947510 706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:01.948575 680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:01.948681 680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "200d41b2cb2346c598c25d0a8746f414"
format_stamp: "Formatted at 2026-08-09 02:25:01 on dist-test-slave-jlzn"
server_key: "e2d2c39095974ce80cbef2159e394557"
server_key_iv: "d0ae1087bb623b4fc7f89e0edf8057ef"
server_key_version: "encryptionkey@0"
I20260809 02:25:01.948761 680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:01.960963 680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:01.963617 680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:01.963757 680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:01.969944 680 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41809
I20260809 02:25:01.969990 776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41809 every 8 connection(s)
I20260809 02:25:01.970743 680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:01.973234 777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:01.973299 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 680
I20260809 02:25:01.973433 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:01.973698 1351 external_mini_cluster.cc:1428] Setting key c8f8e9babfbd66c22694d83fb4136f7d
I20260809 02:25:01.979679 777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414: Bootstrap starting.
I20260809 02:25:01.982110 777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:01.982858 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:01.974903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:55053 (local address 127.0.0.1:41809)
0809 02:25:01.975316 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:01.975335 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:01.975373 (+ 38us) server_negotiation.cc:407] Connection header received
0809 02:25:01.976167 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:01.976192 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:01.976595 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:01.976949 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:01.977312 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:01.978775 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:01.979598 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:01.980272 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:01.980429 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:01.981115 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:01.981121 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:01.981134 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:01.981559 (+ 425us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:01.981624 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:01.981665 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:01.981792 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:01.981896 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 02:25:01.982017 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":107,"threads_started":1}
I20260809 02:25:01.982936 777 log.cc:824] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:01.984750 777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414: No bootstrap required, opened a new log
I20260809 02:25:01.985452 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:01.988386 777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200d41b2cb2346c598c25d0a8746f414" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41809 } }
I20260809 02:25:01.988623 777 raft_consensus.cc:374] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:01.988690 777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200d41b2cb2346c598c25d0a8746f414, State: Initialized, Role: FOLLOWER
I20260809 02:25:01.989087 777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200d41b2cb2346c598c25d0a8746f414" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41809 } }
I20260809 02:25:01.989217 777 raft_consensus.cc:388] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:01.989277 777 raft_consensus.cc:482] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:01.989370 777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:01.990319 777 raft_consensus.cc:504] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200d41b2cb2346c598c25d0a8746f414" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41809 } }
I20260809 02:25:01.990643 777 leader_election.cc:302] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 200d41b2cb2346c598c25d0a8746f414; no voters:
I20260809 02:25:01.990976 777 leader_election.cc:288] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:01.991098 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:01.987266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:44179 (local address 127.0.0.1:41809)
0809 02:25:01.987370 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:01.987374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:01.987489 (+ 115us) server_negotiation.cc:407] Connection header received
0809 02:25:01.987568 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:01.987571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:01.987612 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:01.987697 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:01.987952 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:01.988648 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:01.989515 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:01.989862 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:01.989959 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:01.990606 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:01.990610 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:01.990613 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:01.990625 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:01.990659 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:01.990674 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:01.990767 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:01.990915 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 02:25:01.990947 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:25:01.991333 793 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:01.991515 793 raft_consensus.cc:686] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [term 1 LEADER]: Becoming Leader. State: Replica: 200d41b2cb2346c598c25d0a8746f414, State: Running, Role: LEADER
I20260809 02:25:01.991905 793 consensus_queue.cc:237] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200d41b2cb2346c598c25d0a8746f414" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41809 } }
I20260809 02:25:01.992209 777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:01.993046 793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 200d41b2cb2346c598c25d0a8746f414. Latest consensus state: current_term: 1 leader_uuid: "200d41b2cb2346c598c25d0a8746f414" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200d41b2cb2346c598c25d0a8746f414" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41809 } } }
I20260809 02:25:01.993219 793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:01.993525 795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "200d41b2cb2346c598c25d0a8746f414" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200d41b2cb2346c598c25d0a8746f414" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41809 } } }
I20260809 02:25:01.993631 795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:01.993666 805 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:01.996158 805 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:02.000861 805 catalog_manager.cc:1347] Generated new cluster ID: 8ba6208484d44abeb1cfea1b1d2105af
I20260809 02:25:02.000922 805 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:02.005304 805 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:02.006382 805 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:02.022552 805 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 200d41b2cb2346c598c25d0a8746f414: Generated new TSK 0
I20260809 02:25:02.023201 805 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:02.034741 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 680
W20260809 02:25:02.055681 661 connection.cc:535] client connection to 127.0.0.1:41809 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41809): Connection reset by peer (error 104)
2026-08-09T02:25:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:02 dist-test-slave-jlzn krb5kdc[824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:02 dist-test-slave-jlzn krb5kdc[824](info): set up 2 sockets
Aug 09 02:25:02 dist-test-slave-jlzn krb5kdc[824](info): commencing operation
krb5kdc: starting...
W20260809 02:25:03.173555 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:03 dist-test-slave-jlzn krb5kdc[824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:25:03.284523 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36163
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:03.390578 841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:03.390805 841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:03.390841 841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:03.394712 841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:03.394763 841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:03.394781 841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:03.394795 841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:03.394814 841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:03.399688 841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:03.400545 841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:03.401387 841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:03.409137 850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:03.409168 852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:03.409188 854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:03.409334 841 server_base.cc:1034] running on GCE node
I20260809 02:25:03.409940 841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:03.410878 841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:03.412029 841 hybrid_clock.cc:648] HybridClock initialized: now 1786242303412017 us; error 28 us; skew 500 ppm
Aug 09 02:25:03 dist-test-slave-jlzn krb5kdc[824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242303, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:03.414577 841 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:25:03.415380 841 webserver.cc:460] Webserver started at http://127.0.0.1:44631/ using document root <none> and password file <none>
I20260809 02:25:03.415899 841 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:03.415964 841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:03.416164 841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:03.418002 841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "b0d638718da14ae685e87c9083062c05"
format_stamp: "Formatted at 2026-08-09 02:25:03 on dist-test-slave-jlzn"
server_key: "85eb54a45805d181d317ed684641613d"
server_key_iv: "10bfed6838606238e7f49248a7f6ef58"
server_key_version: "encryptionkey@0"
I20260809 02:25:03.418517 841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "b0d638718da14ae685e87c9083062c05"
format_stamp: "Formatted at 2026-08-09 02:25:03 on dist-test-slave-jlzn"
server_key: "85eb54a45805d181d317ed684641613d"
server_key_iv: "10bfed6838606238e7f49248a7f6ef58"
server_key_version: "encryptionkey@0"
I20260809 02:25:03.421900 841 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:25:03.424098 863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:03.425172 841 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:03.425274 841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "b0d638718da14ae685e87c9083062c05"
format_stamp: "Formatted at 2026-08-09 02:25:03 on dist-test-slave-jlzn"
server_key: "85eb54a45805d181d317ed684641613d"
server_key_iv: "10bfed6838606238e7f49248a7f6ef58"
server_key_version: "encryptionkey@0"
I20260809 02:25:03.425369 841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:03.429564 841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:03.432436 841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:03.432591 841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:03.439062 841 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36163
I20260809 02:25:03.439103 936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36163 every 8 connection(s)
I20260809 02:25:03.439915 841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:03.442408 937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:03.447373 937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05: Bootstrap starting.
I20260809 02:25:03.449195 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 841
I20260809 02:25:03.449314 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:03.449553 1351 external_mini_cluster.cc:1428] Setting key afc17e8e722ffbabf93dc7426c6b4b17
I20260809 02:25:03.449764 937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:03.450608 937 log.cc:824] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:03.452701 937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05: No bootstrap required, opened a new log
I20260809 02:25:03.454340 943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:03.450522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:51549 (local address 127.0.0.1:36163)
0809 02:25:03.450949 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:03.450967 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:03.451010 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:25:03.451768 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:03.451791 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:03.452146 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:03.452484 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:03.453094 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:03.453100 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:03.453114 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:03.453125 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:03.453179 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:03.453203 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:03.453307 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:03.453381 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 02:25:03.453520 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":127,"threads_started":1}
I20260809 02:25:03.456801 937 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d638718da14ae685e87c9083062c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } }
I20260809 02:25:03.457020 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:03.457037 937 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:03.457104 937 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0d638718da14ae685e87c9083062c05, State: Initialized, Role: FOLLOWER
I20260809 02:25:03.457525 937 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d638718da14ae685e87c9083062c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } }
I20260809 02:25:03.457679 937 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:03.457739 937 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:03.457832 937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:03.458881 937 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d638718da14ae685e87c9083062c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } }
I20260809 02:25:03.459213 937 leader_election.cc:302] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0d638718da14ae685e87c9083062c05; no voters:
I20260809 02:25:03.459602 937 leader_election.cc:288] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:03.459678 957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:03.459920 957 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [term 1 LEADER]: Becoming Leader. State: Replica: b0d638718da14ae685e87c9083062c05, State: Running, Role: LEADER
I20260809 02:25:03.460253 957 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d638718da14ae685e87c9083062c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } }
I20260809 02:25:03.460812 937 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:03.461236 943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:03.459266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:39865 (local address 127.0.0.1:36163)
0809 02:25:03.459383 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:03.459387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:03.459596 (+ 209us) server_negotiation.cc:407] Connection header received
0809 02:25:03.459751 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:03.459754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:03.459789 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:03.459880 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:03.460666 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:03.460669 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:03.460672 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:03.460684 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:03.460712 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:03.460724 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:03.460825 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:03.461089 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 02:25:03.461126 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:25:03.461361 957 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0d638718da14ae685e87c9083062c05. Latest consensus state: current_term: 1 leader_uuid: "b0d638718da14ae685e87c9083062c05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d638718da14ae685e87c9083062c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } } }
I20260809 02:25:03.461544 957 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:03.461776 958 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0d638718da14ae685e87c9083062c05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d638718da14ae685e87c9083062c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } } }
I20260809 02:25:03.461913 958 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:03.462527 966 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:03.465448 966 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:03.470743 966 catalog_manager.cc:1347] Generated new cluster ID: 40af58e3739a4bc78556f3fdffcb6464
I20260809 02:25:03.470803 966 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:03.489168 966 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:03.489423 966 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:03.502585 966 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0d638718da14ae685e87c9083062c05: Generated new TSK 0
I20260809 02:25:03.503159 966 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:03.507197 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 841
2026-08-09T02:25:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1464 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:03 dist-test-slave-jlzn krb5kdc[985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:03 dist-test-slave-jlzn krb5kdc[985](info): set up 2 sockets
Aug 09 02:25:03 dist-test-slave-jlzn krb5kdc[985](info): commencing operation
krb5kdc: starting...
W20260809 02:25:04.632566 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:04 dist-test-slave-jlzn krb5kdc[985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:25:04.743734 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34325
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:04.849668 1008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:04.849877 1008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:04.849918 1008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:04.853768 1008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:04.853817 1008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:04.853835 1008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:04.853865 1008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:04.853891 1008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:04.859148 1008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34325
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:04.860025 1008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:04.860881 1008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:04.869867 1017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:04.869863 1019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:04.870278 1023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:04.870788 1008 server_base.cc:1034] running on GCE node
I20260809 02:25:04.871342 1008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:04.872514 1008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:04.873682 1008 hybrid_clock.cc:648] HybridClock initialized: now 1786242304873658 us; error 41 us; skew 500 ppm
Aug 09 02:25:04 dist-test-slave-jlzn krb5kdc[985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242304, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:04.876140 1008 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:25:04.876961 1008 webserver.cc:460] Webserver started at http://127.0.0.1:44793/ using document root <none> and password file <none>
I20260809 02:25:04.877435 1008 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:04.877501 1008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:04.877696 1008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:04.879503 1008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "6cdfbb16a66d418aba146f5ae7310da7"
format_stamp: "Formatted at 2026-08-09 02:25:04 on dist-test-slave-jlzn"
server_key: "488eb1108f646d6a608466bce9cd6cad"
server_key_iv: "b898a89ca1345f93a3f8b934fc6a6952"
server_key_version: "encryptionkey@0"
I20260809 02:25:04.880041 1008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "6cdfbb16a66d418aba146f5ae7310da7"
format_stamp: "Formatted at 2026-08-09 02:25:04 on dist-test-slave-jlzn"
server_key: "488eb1108f646d6a608466bce9cd6cad"
server_key_iv: "b898a89ca1345f93a3f8b934fc6a6952"
server_key_version: "encryptionkey@0"
I20260809 02:25:04.883275 1008 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260809 02:25:04.885442 1033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:04.886469 1008 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:04.886579 1008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "6cdfbb16a66d418aba146f5ae7310da7"
format_stamp: "Formatted at 2026-08-09 02:25:04 on dist-test-slave-jlzn"
server_key: "488eb1108f646d6a608466bce9cd6cad"
server_key_iv: "b898a89ca1345f93a3f8b934fc6a6952"
server_key_version: "encryptionkey@0"
I20260809 02:25:04.886684 1008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:04.915781 1008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:04.918105 1008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:04.918262 1008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:04.924685 1008 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34325
I20260809 02:25:04.924702 1114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34325 every 8 connection(s)
I20260809 02:25:04.925485 1008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:04.927983 1115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:04.928900 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1008
I20260809 02:25:04.929019 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:04.929294 1351 external_mini_cluster.cc:1428] Setting key 62a49b3aa54e47404aae4c96c3e74687
I20260809 02:25:04.933951 1115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7: Bootstrap starting.
I20260809 02:25:04.936331 1115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:04.937101 1115 log.cc:824] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:25:04 dist-test-slave-jlzn krb5kdc[985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:25:04.939072 1115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7: No bootstrap required, opened a new log
I20260809 02:25:04.942826 1115 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdfbb16a66d418aba146f5ae7310da7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34325 } }
I20260809 02:25:04.942960 1118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:04.930539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:56665 (local address 127.0.0.1:34325)
0809 02:25:04.930925 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:04.930943 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:04.930982 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:25:04.931787 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:04.931830 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:04.932237 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:04.932563 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:04.933211 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:04.934570 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:04.935410 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:04.936069 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:04.936241 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:04.938794 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:04.938800 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:04.938811 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:04.938835 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:04.940349 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:04.940895 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:04.940899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:04.940903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:04.941003 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:04.941323 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:04.941325 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:04.941326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:04.941647 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:04.941806 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:04.942093 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 02:25:04.942288 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":98,"threads_started":1}
I20260809 02:25:04.943024 1115 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:04.943063 1115 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdfbb16a66d418aba146f5ae7310da7, State: Initialized, Role: FOLLOWER
I20260809 02:25:04.943439 1115 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdfbb16a66d418aba146f5ae7310da7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34325 } }
I20260809 02:25:04.943552 1115 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:04.943610 1115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:04.943713 1115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:04.944685 1115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdfbb16a66d418aba146f5ae7310da7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34325 } }
I20260809 02:25:04.945043 1115 leader_election.cc:302] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cdfbb16a66d418aba146f5ae7310da7; no voters:
I20260809 02:25:04.945312 1115 leader_election.cc:288] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:04.945397 1121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:04.945552 1121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [term 1 LEADER]: Becoming Leader. State: Replica: 6cdfbb16a66d418aba146f5ae7310da7, State: Running, Role: LEADER
I20260809 02:25:04.945672 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:04.945878 1121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdfbb16a66d418aba146f5ae7310da7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34325 } }
I20260809 02:25:04.946457 1115 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:04.946950 1121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cdfbb16a66d418aba146f5ae7310da7. Latest consensus state: current_term: 1 leader_uuid: "6cdfbb16a66d418aba146f5ae7310da7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdfbb16a66d418aba146f5ae7310da7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34325 } } }
I20260809 02:25:04.947052 1121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:04.947320 1122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cdfbb16a66d418aba146f5ae7310da7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdfbb16a66d418aba146f5ae7310da7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34325 } } }
I20260809 02:25:04.947450 1122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7 [sys.catalog]: This master's current role is: LEADER
W20260809 02:25:04.951014 1146 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:04.951395 1146 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:04.951494 1133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:04.952404 1133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:04.956187 1118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:04.947868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:46715 (local address 127.0.0.1:34325)
0809 02:25:04.947967 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:04.947971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:04.948351 (+ 380us) server_negotiation.cc:407] Connection header received
0809 02:25:04.948489 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:04.948492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:04.948533 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:04.948578 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:04.949337 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:04.950024 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:04.951122 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:04.951443 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:04.951560 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:04.953176 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:04.953180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:04.953183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:04.953208 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:04.954600 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:04.955046 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:04.955048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:04.955049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:04.955120 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:04.955412 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:04.955415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:04.955417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:04.955568 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:04.955698 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:04.955971 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 02:25:04.956053 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 02:25:04.958031 1133 catalog_manager.cc:1347] Generated new cluster ID: 75646cb11cb54fba86be17af2c32b2f0
I20260809 02:25:04.958081 1133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:04.969034 1133 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:04.969805 1133 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:04.980973 1133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cdfbb16a66d418aba146f5ae7310da7: Generated new TSK 0
I20260809 02:25:04.981492 1133 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:04.988809 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1008
W20260809 02:25:05.000240 983 connection.cc:535] client connection to 127.0.0.1:34325 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34325): Connection reset by peer (error 104)
2026-08-09T02:25:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1479 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:05 dist-test-slave-jlzn krb5kdc[1158](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:05 dist-test-slave-jlzn krb5kdc[1158](info): set up 2 sockets
Aug 09 02:25:05 dist-test-slave-jlzn krb5kdc[1158](info): commencing operation
krb5kdc: starting...
W20260809 02:25:06.107184 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:06 dist-test-slave-jlzn krb5kdc[1158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:25:06.219710 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46659
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:06.324486 1175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:06.324709 1175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:06.324765 1175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:06.328616 1175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:06.328673 1175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:06.328699 1175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:06.328720 1175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:06.328747 1175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:06.333636 1175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46659
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:06.334504 1175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:06.335361 1175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:06.343037 1183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:06.343039 1187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:06.343227 1175 server_base.cc:1034] running on GCE node
W20260809 02:25:06.343091 1190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:06.343876 1175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:06.344795 1175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:06.345947 1175 hybrid_clock.cc:648] HybridClock initialized: now 1786242306345935 us; error 25 us; skew 500 ppm
Aug 09 02:25:06 dist-test-slave-jlzn krb5kdc[1158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242306, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:06.352164 1175 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:25:06.352929 1175 webserver.cc:460] Webserver started at http://127.0.0.1:42427/ using document root <none> and password file <none>
I20260809 02:25:06.353407 1175 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:06.353467 1175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:06.353657 1175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:06.355459 1175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b"
format_stamp: "Formatted at 2026-08-09 02:25:06 on dist-test-slave-jlzn"
server_key: "c753668d476ae3d5dfe3e7b29f23218e"
server_key_iv: "0da4bd427bdaabba5ef28c35851b2e0d"
server_key_version: "encryptionkey@0"
I20260809 02:25:06.355983 1175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b"
format_stamp: "Formatted at 2026-08-09 02:25:06 on dist-test-slave-jlzn"
server_key: "c753668d476ae3d5dfe3e7b29f23218e"
server_key_iv: "0da4bd427bdaabba5ef28c35851b2e0d"
server_key_version: "encryptionkey@0"
I20260809 02:25:06.359213 1175 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260809 02:25:06.361342 1199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:06.362375 1175 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 02:25:06.362496 1175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b"
format_stamp: "Formatted at 2026-08-09 02:25:06 on dist-test-slave-jlzn"
server_key: "c753668d476ae3d5dfe3e7b29f23218e"
server_key_iv: "0da4bd427bdaabba5ef28c35851b2e0d"
server_key_version: "encryptionkey@0"
I20260809 02:25:06.362582 1175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:06.376665 1175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:06.379340 1175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:06.379493 1175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:06.385897 1175 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46659
I20260809 02:25:06.385910 1278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46659 every 8 connection(s)
I20260809 02:25:06.386757 1175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:06.389247 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:06.394208 1279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b: Bootstrap starting.
I20260809 02:25:06.394520 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1175
I20260809 02:25:06.394659 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:06.394956 1351 external_mini_cluster.cc:1428] Setting key ed794ca76d40c9fff5c9cd98b5090ba4
I20260809 02:25:06.396724 1279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:06.397383 1279 log.cc:824] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:06.399163 1279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b: No bootstrap required, opened a new log
I20260809 02:25:06.403153 1282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:06.396164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:60059 (local address 127.0.0.1:46659)
0809 02:25:06.396516 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:06.396530 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:06.396563 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:25:06.397177 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:06.397194 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:06.397516 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:06.397821 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:06.398195 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:06.399112 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:06.400316 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:06.400766 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:06.400877 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:06.401658 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:06.401663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:06.401675 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:06.402005 (+ 330us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:06.402053 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:06.402074 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:06.402170 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:06.402347 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:25:06.402464 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":87,"threads_started":1}
I20260809 02:25:06.403026 1279 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } }
I20260809 02:25:06.403245 1279 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:06.403292 1279 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0fc3c6a78b9486bad1d0cf741d6f02b, State: Initialized, Role: FOLLOWER
I20260809 02:25:06.403700 1279 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } }
I20260809 02:25:06.403859 1279 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:06.403929 1279 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:06.404026 1279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:06.404793 1279 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } }
I20260809 02:25:06.405131 1279 leader_election.cc:302] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0fc3c6a78b9486bad1d0cf741d6f02b; no voters:
I20260809 02:25:06.405411 1279 leader_election.cc:288] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:06.405498 1285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:06.405678 1285 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [term 1 LEADER]: Becoming Leader. State: Replica: f0fc3c6a78b9486bad1d0cf741d6f02b, State: Running, Role: LEADER
I20260809 02:25:06.405817 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:06.406009 1285 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } }
I20260809 02:25:06.406579 1279 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:06.407125 1285 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fc3c6a78b9486bad1d0cf741d6f02b. Latest consensus state: current_term: 1 leader_uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } } }
I20260809 02:25:06.407255 1285 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:06.407503 1286 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fc3c6a78b9486bad1d0cf741d6f02b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46659 } } }
I20260809 02:25:06.407600 1286 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b [sys.catalog]: This master's current role is: LEADER
W20260809 02:25:06.410993 1319 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:06.411060 1319 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:06.411139 1304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:06.411975 1304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:06.412346 1282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:06.407944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:48881 (local address 127.0.0.1:46659)
0809 02:25:06.408038 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:06.408041 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:06.408489 (+ 448us) server_negotiation.cc:407] Connection header received
0809 02:25:06.408763 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:06.408767 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:06.408814 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:06.408864 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:06.409296 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:06.409987 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:06.410799 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:06.411030 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:06.411115 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:06.411897 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:06.411901 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:06.411904 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:06.411916 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:06.411939 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:06.411949 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:06.412013 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:06.412190 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:25:06.412223 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:25:06.416818 1304 catalog_manager.cc:1347] Generated new cluster ID: f259896b536c435585e92a0cabd94eb7
I20260809 02:25:06.416921 1304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:06.462723 1304 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:06.463544 1304 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:06.472198 1304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0fc3c6a78b9486bad1d0cf741d6f02b: Generated new TSK 0
I20260809 02:25:06.472756 1304 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:06.481418 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1175
W20260809 02:25:06.498159 1153 connection.cc:535] client connection to 127.0.0.1:46659 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46659): Connection reset by peer (error 104)
2026-08-09T02:25:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1497 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:06 dist-test-slave-jlzn krb5kdc[1330](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:06 dist-test-slave-jlzn krb5kdc[1330](info): set up 2 sockets
Aug 09 02:25:06 dist-test-slave-jlzn krb5kdc[1330](info): commencing operation
krb5kdc: starting...
W20260809 02:25:07.613368 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:07 dist-test-slave-jlzn krb5kdc[1330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:25:07.724646 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40677
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:07.829974 1350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:07.830210 1350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:07.830269 1350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:07.834218 1350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:07.834271 1350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:07.834298 1350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:07.834321 1350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:07.834349 1350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:07.839243 1350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40677
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:07.840147 1350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:07.841027 1350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:07.848567 1364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:07.848595 1368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:07.848717 1350 server_base.cc:1034] running on GCE node
W20260809 02:25:07.848521 1365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:07.849313 1350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:07.850297 1350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:07.851452 1350 hybrid_clock.cc:648] HybridClock initialized: now 1786242307851436 us; error 28 us; skew 500 ppm
Aug 09 02:25:07 dist-test-slave-jlzn krb5kdc[1330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242307, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:07.853960 1350 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:25:07.854732 1350 webserver.cc:460] Webserver started at http://127.0.0.1:37807/ using document root <none> and password file <none>
I20260809 02:25:07.855213 1350 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:07.855279 1350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:07.855450 1350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:07.857311 1350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "a7a934e1a0ee4af79093d1218f680b03"
format_stamp: "Formatted at 2026-08-09 02:25:07 on dist-test-slave-jlzn"
server_key: "61c6d60c25abbc27531219651bb0ecb3"
server_key_iv: "9606c4bf5ce46678d6685447ccd3ab3b"
server_key_version: "encryptionkey@0"
I20260809 02:25:07.857825 1350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "a7a934e1a0ee4af79093d1218f680b03"
format_stamp: "Formatted at 2026-08-09 02:25:07 on dist-test-slave-jlzn"
server_key: "61c6d60c25abbc27531219651bb0ecb3"
server_key_iv: "9606c4bf5ce46678d6685447ccd3ab3b"
server_key_version: "encryptionkey@0"
I20260809 02:25:07.861191 1350 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 02:25:07.863333 1380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:07.864455 1350 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:07.864565 1350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "a7a934e1a0ee4af79093d1218f680b03"
format_stamp: "Formatted at 2026-08-09 02:25:07 on dist-test-slave-jlzn"
server_key: "61c6d60c25abbc27531219651bb0ecb3"
server_key_iv: "9606c4bf5ce46678d6685447ccd3ab3b"
server_key_version: "encryptionkey@0"
I20260809 02:25:07.864655 1350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:07.868813 1350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:07.871239 1350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:07.871394 1350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:07.877759 1350 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40677
I20260809 02:25:07.877769 1456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40677 every 8 connection(s)
I20260809 02:25:07.878561 1350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:07.879197 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1350
I20260809 02:25:07.879335 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:07.879616 1351 external_mini_cluster.cc:1428] Setting key 4becfc260f81960d7938334f319ac699
I20260809 02:25:07.881639 1457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:07.884658 1463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:07.880857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:36521 (local address 127.0.0.1:40677)
0809 02:25:07.881250 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:07.881268 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:07.881306 (+ 38us) server_negotiation.cc:407] Connection header received
0809 02:25:07.882076 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:07.882098 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:07.882431 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:07.882763 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:07.883365 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:07.883371 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:07.883384 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:07.883395 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:07.883449 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:07.883473 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:07.883606 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:07.883669 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 02:25:07.883840 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":98,"threads_started":1}
I20260809 02:25:07.887259 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:07.887960 1457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03: Bootstrap starting.
I20260809 02:25:07.890458 1457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:07.890964 1463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:07.889463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:42411 (local address 127.0.0.1:40677)
0809 02:25:07.889562 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:07.889566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:07.889805 (+ 239us) server_negotiation.cc:407] Connection header received
0809 02:25:07.889908 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:07.889910 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:07.889939 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:07.890000 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:07.890631 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:07.890634 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:07.890635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:07.890646 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:07.890670 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:07.890680 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:07.890746 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:07.890841 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 02:25:07.890869 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:25:07.891289 1457 log.cc:824] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:07.893081 1457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03: No bootstrap required, opened a new log
I20260809 02:25:07.896507 1457 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a934e1a0ee4af79093d1218f680b03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40677 } }
I20260809 02:25:07.896708 1457 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:07.896749 1457 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7a934e1a0ee4af79093d1218f680b03, State: Initialized, Role: FOLLOWER
I20260809 02:25:07.897063 1457 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a934e1a0ee4af79093d1218f680b03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40677 } }
I20260809 02:25:07.897168 1457 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:07.897212 1457 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:07.897276 1457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:07.897994 1457 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a934e1a0ee4af79093d1218f680b03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40677 } }
I20260809 02:25:07.898267 1457 leader_election.cc:302] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7a934e1a0ee4af79093d1218f680b03; no voters:
I20260809 02:25:07.898494 1457 leader_election.cc:288] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:07.898592 1472 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:07.898789 1472 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [term 1 LEADER]: Becoming Leader. State: Replica: a7a934e1a0ee4af79093d1218f680b03, State: Running, Role: LEADER
I20260809 02:25:07.899122 1472 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a934e1a0ee4af79093d1218f680b03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40677 } }
I20260809 02:25:07.899494 1457 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:07.900698 1474 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7a934e1a0ee4af79093d1218f680b03. Latest consensus state: current_term: 1 leader_uuid: "a7a934e1a0ee4af79093d1218f680b03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a934e1a0ee4af79093d1218f680b03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40677 } } }
I20260809 02:25:07.900714 1473 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7a934e1a0ee4af79093d1218f680b03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a934e1a0ee4af79093d1218f680b03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40677 } } }
I20260809 02:25:07.900812 1474 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:07.900830 1473 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:07.901258 1484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:07.904071 1484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:07.909178 1484 catalog_manager.cc:1347] Generated new cluster ID: 8853b46c954949a1874ec0a9fb5cb1ba
I20260809 02:25:07.909228 1484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:07.917409 1484 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:07.917647 1484 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:07.927676 1484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7a934e1a0ee4af79093d1218f680b03: Generated new TSK 0
I20260809 02:25:07.928231 1484 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:07.935742 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1350
2026-08-09T02:25:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:07 dist-test-slave-jlzn krb5kdc[1504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:07 dist-test-slave-jlzn krb5kdc[1504](info): set up 2 sockets
Aug 09 02:25:07 dist-test-slave-jlzn krb5kdc[1504](info): commencing operation
krb5kdc: starting...
W20260809 02:25:09.062757 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:09 dist-test-slave-jlzn krb5kdc[1504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:25:09.175778 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43383
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:37835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:43383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:09.281380 1523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:09.281603 1523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:09.281659 1523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:09.285483 1523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:09.285537 1523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:09.285570 1523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:09.285593 1523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:09.285621 1523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:09.291709 1523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:37835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:43383
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:43383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:09.292951 1523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:09.294252 1523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:09.305416 1529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:09.305469 1528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:09.305593 1533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:09.305778 1523 server_base.cc:1034] running on GCE node
I20260809 02:25:09.306425 1523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:09.307772 1523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:09.309037 1523 hybrid_clock.cc:648] HybridClock initialized: now 1786242309309019 us; error 31 us; skew 500 ppm
Aug 09 02:25:09 dist-test-slave-jlzn krb5kdc[1504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242309, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:09.312278 1523 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:25:09.313323 1523 webserver.cc:460] Webserver started at http://127.1.81.254:45679/ using document root <none> and password file <none>
I20260809 02:25:09.314023 1523 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:09.314106 1523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:09.314337 1523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:09.316460 1523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "3a85f5e130ad41c4bc53fe3ee8794229"
format_stamp: "Formatted at 2026-08-09 02:25:09 on dist-test-slave-jlzn"
server_key: "8f2d1269b3cebc905b37d928bac51099"
server_key_iv: "d13d16e7f20c67f1b469d0b4524cc479"
server_key_version: "encryptionkey@0"
I20260809 02:25:09.317080 1523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "3a85f5e130ad41c4bc53fe3ee8794229"
format_stamp: "Formatted at 2026-08-09 02:25:09 on dist-test-slave-jlzn"
server_key: "8f2d1269b3cebc905b37d928bac51099"
server_key_iv: "d13d16e7f20c67f1b469d0b4524cc479"
server_key_version: "encryptionkey@0"
I20260809 02:25:09.321338 1523 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:25:09.324250 1544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:09.325717 1523 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:25:09.325836 1523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "3a85f5e130ad41c4bc53fe3ee8794229"
format_stamp: "Formatted at 2026-08-09 02:25:09 on dist-test-slave-jlzn"
server_key: "8f2d1269b3cebc905b37d928bac51099"
server_key_iv: "d13d16e7f20c67f1b469d0b4524cc479"
server_key_version: "encryptionkey@0"
I20260809 02:25:09.325942 1523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:09.366915 1523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:09.369756 1523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:09.369921 1523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:09.376395 1523 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:43383
I20260809 02:25:09.376421 1615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:43383 every 8 connection(s)
I20260809 02:25:09.377245 1523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:09.379776 1616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:09.381059 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1523
I20260809 02:25:09.381215 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:09.381532 1351 external_mini_cluster.cc:1428] Setting key a507384399e496ba711df30290ef3ab3
I20260809 02:25:09.385565 1616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229: Bootstrap starting.
I20260809 02:25:09.387622 1616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:09.388351 1616 log.cc:824] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:25:09 dist-test-slave-jlzn krb5kdc[1504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:25:09.390142 1616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229: No bootstrap required, opened a new log
I20260809 02:25:09.393500 1616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a85f5e130ad41c4bc53fe3ee8794229" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43383 } }
I20260809 02:25:09.393774 1616 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:09.393838 1616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a85f5e130ad41c4bc53fe3ee8794229, State: Initialized, Role: FOLLOWER
I20260809 02:25:09.394240 1616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a85f5e130ad41c4bc53fe3ee8794229" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43383 } }
I20260809 02:25:09.394376 1616 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:09.394441 1616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:09.394515 1620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:09.382830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59265 (local address 127.1.81.254:43383)
0809 02:25:09.383248 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:09.383263 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:09.383297 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:25:09.383950 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:09.383967 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:09.384284 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:09.384572 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:09.385330 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:09.386290 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:09.387124 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:09.387571 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:09.387716 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:09.390165 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:09.390170 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:09.390183 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:09.390208 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:09.391697 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:09.392200 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:09.392205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:09.392209 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:09.392318 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:09.392641 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:09.392644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:09.392645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:09.392986 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:09.393210 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:09.393479 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 02:25:09.393704 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":128,"threads_started":1}
I20260809 02:25:09.394533 1616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:09.395517 1616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a85f5e130ad41c4bc53fe3ee8794229" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43383 } }
I20260809 02:25:09.395879 1616 leader_election.cc:302] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a85f5e130ad41c4bc53fe3ee8794229; no voters:
I20260809 02:25:09.396193 1616 leader_election.cc:288] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:09.396283 1625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:09.396446 1625 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [term 1 LEADER]: Becoming Leader. State: Replica: 3a85f5e130ad41c4bc53fe3ee8794229, State: Running, Role: LEADER
I20260809 02:25:09.396719 1625 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a85f5e130ad41c4bc53fe3ee8794229" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43383 } }
I20260809 02:25:09.397358 1616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:09.397477 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:09.397837 1626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a85f5e130ad41c4bc53fe3ee8794229. Latest consensus state: current_term: 1 leader_uuid: "3a85f5e130ad41c4bc53fe3ee8794229" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a85f5e130ad41c4bc53fe3ee8794229" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43383 } } }
I20260809 02:25:09.397871 1627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a85f5e130ad41c4bc53fe3ee8794229" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a85f5e130ad41c4bc53fe3ee8794229" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 43383 } } }
I20260809 02:25:09.397959 1626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:09.397969 1627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:09.398341 1631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:09.401396 1631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:09.407651 1620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:09.399976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37927 (local address 127.1.81.254:43383)
0809 02:25:09.400087 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:09.400091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:09.400426 (+ 335us) server_negotiation.cc:407] Connection header received
0809 02:25:09.400552 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:09.400555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:09.400593 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:09.400657 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:09.401379 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:09.401914 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:09.402936 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:09.403165 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:09.403249 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:09.404542 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:09.404545 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:09.404547 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:09.404569 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:09.405962 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:09.406481 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:09.406485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:09.406486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:09.406562 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:09.406867 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:09.406870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:09.406871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:09.407030 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:09.407159 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:09.407431 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 02:25:09.407513 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:25:09.407825 1631 catalog_manager.cc:1347] Generated new cluster ID: 54dd26d519fe4471b07d2874e0600896
I20260809 02:25:09.407882 1631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:09.440901 1631 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:09.441756 1631 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:09.448658 1631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a85f5e130ad41c4bc53fe3ee8794229: Generated new TSK 0
I20260809 02:25:09.449214 1631 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:09.461026 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1523
W20260809 02:25:09.472285 1500 connection.cc:535] client connection to 127.1.81.254:43383 recv error: Network error: failed to read from TLS socket (remote: 127.1.81.254:43383): Connection reset by peer (error 104)
2026-08-09T02:25:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1524 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:09 dist-test-slave-jlzn krb5kdc[1657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:09 dist-test-slave-jlzn krb5kdc[1657](info): set up 2 sockets
Aug 09 02:25:09 dist-test-slave-jlzn krb5kdc[1657](info): commencing operation
krb5kdc: starting...
W20260809 02:25:10.581200 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:10 dist-test-slave-jlzn krb5kdc[1657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:25:10.692416 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44789
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:44789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:10.797863 1677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:10.798070 1677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:10.798111 1677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:10.801947 1677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:10.801997 1677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:10.802022 1677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:10.802052 1677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:10.802079 1677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:10.806934 1677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:44789
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:10.807780 1677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:10.808683 1677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:10.816391 1685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:10.816443 1687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:10.816408 1684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:10.816591 1677 server_base.cc:1034] running on GCE node
I20260809 02:25:10.817116 1677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:10.818040 1677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:10.819201 1677 hybrid_clock.cc:648] HybridClock initialized: now 1786242310819183 us; error 29 us; skew 500 ppm
Aug 09 02:25:10 dist-test-slave-jlzn krb5kdc[1657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242310, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:10.821702 1677 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:25:10.822494 1677 webserver.cc:460] Webserver started at http://127.1.81.254:43599/ using document root <none> and password file <none>
I20260809 02:25:10.822960 1677 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:10.823020 1677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:10.823207 1677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:10.825026 1677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "acff7a0d60e54dabba75cf44fc78bdbe"
format_stamp: "Formatted at 2026-08-09 02:25:10 on dist-test-slave-jlzn"
server_key: "4b5a3549bc1851151ed65aff320fad48"
server_key_iv: "0788942593fbb1b06c24922086eeed3d"
server_key_version: "encryptionkey@0"
I20260809 02:25:10.825529 1677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "acff7a0d60e54dabba75cf44fc78bdbe"
format_stamp: "Formatted at 2026-08-09 02:25:10 on dist-test-slave-jlzn"
server_key: "4b5a3549bc1851151ed65aff320fad48"
server_key_iv: "0788942593fbb1b06c24922086eeed3d"
server_key_version: "encryptionkey@0"
I20260809 02:25:10.828792 1677 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 02:25:10.830894 1696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:10.831998 1677 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260809 02:25:10.832113 1677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "acff7a0d60e54dabba75cf44fc78bdbe"
format_stamp: "Formatted at 2026-08-09 02:25:10 on dist-test-slave-jlzn"
server_key: "4b5a3549bc1851151ed65aff320fad48"
server_key_iv: "0788942593fbb1b06c24922086eeed3d"
server_key_version: "encryptionkey@0"
I20260809 02:25:10.832196 1677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:10.848489 1677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:10.851207 1677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:10.851358 1677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:10.857842 1677 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:44789
I20260809 02:25:10.857857 1773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:44789 every 8 connection(s)
I20260809 02:25:10.858695 1677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:10.861341 1774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:10.867116 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1677
I20260809 02:25:10.867254 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:10.867554 1351 external_mini_cluster.cc:1428] Setting key 61701f6396327b3f34fc70d518258762
I20260809 02:25:10.867600 1774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe: Bootstrap starting.
I20260809 02:25:10.870226 1774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:10.870939 1774 log.cc:824] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:10.872784 1774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe: No bootstrap required, opened a new log
I20260809 02:25:10.876201 1774 raft_consensus.cc:348] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acff7a0d60e54dabba75cf44fc78bdbe" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44789 } }
I20260809 02:25:10.876379 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:10.868999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40129 (local address 127.1.81.254:44789)
0809 02:25:10.869459 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:10.869478 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:10.869520 (+ 42us) server_negotiation.cc:407] Connection header received
0809 02:25:10.870228 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:10.870244 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:10.870594 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:10.870878 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:10.871274 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:10.872450 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:10.873375 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:10.873832 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:10.873974 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:10.874774 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:10.874779 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:10.874791 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:10.875156 (+ 365us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:10.875209 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:10.875230 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:10.875345 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:10.875508 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 02:25:10.875638 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":130,"threads_started":1}
I20260809 02:25:10.876412 1774 raft_consensus.cc:374] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:10.876466 1774 raft_consensus.cc:729] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acff7a0d60e54dabba75cf44fc78bdbe, State: Initialized, Role: FOLLOWER
I20260809 02:25:10.876921 1774 consensus_queue.cc:260] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acff7a0d60e54dabba75cf44fc78bdbe" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44789 } }
I20260809 02:25:10.877080 1774 raft_consensus.cc:388] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:10.877152 1774 raft_consensus.cc:482] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:10.877249 1774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:10.878062 1774 raft_consensus.cc:504] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acff7a0d60e54dabba75cf44fc78bdbe" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44789 } }
I20260809 02:25:10.878407 1774 leader_election.cc:302] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acff7a0d60e54dabba75cf44fc78bdbe; no voters:
I20260809 02:25:10.878728 1774 leader_election.cc:288] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:10.878805 1780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:10.879004 1780 raft_consensus.cc:686] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [term 1 LEADER]: Becoming Leader. State: Replica: acff7a0d60e54dabba75cf44fc78bdbe, State: Running, Role: LEADER
I20260809 02:25:10.879311 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:10.879345 1780 consensus_queue.cc:237] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acff7a0d60e54dabba75cf44fc78bdbe" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44789 } }
I20260809 02:25:10.879977 1774 sys_catalog.cc:564] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:10.880823 1782 sys_catalog.cc:455] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acff7a0d60e54dabba75cf44fc78bdbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acff7a0d60e54dabba75cf44fc78bdbe" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44789 } } }
I20260809 02:25:10.880940 1782 sys_catalog.cc:458] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:10.881299 1783 sys_catalog.cc:455] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader acff7a0d60e54dabba75cf44fc78bdbe. Latest consensus state: current_term: 1 leader_uuid: "acff7a0d60e54dabba75cf44fc78bdbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acff7a0d60e54dabba75cf44fc78bdbe" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44789 } } }
I20260809 02:25:10.881438 1783 sys_catalog.cc:458] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:10.882341 1797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:10.885113 1797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:10.886126 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:10.881559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49585 (local address 127.1.81.254:44789)
0809 02:25:10.881653 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:10.881657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:10.882131 (+ 474us) server_negotiation.cc:407] Connection header received
0809 02:25:10.882261 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:10.882265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:10.882307 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:10.882375 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:10.882809 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:10.883302 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:10.884403 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:10.884730 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:10.884835 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:10.885676 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:10.885680 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:10.885682 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:10.885695 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:10.885722 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:10.885736 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:10.885818 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:10.885977 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 02:25:10.886009 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 02:25:10.890188 1797 catalog_manager.cc:1347] Generated new cluster ID: a8d014601b9c43aaa08986a4b2bd94d7
I20260809 02:25:10.890239 1797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:10.911332 1797 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:10.912184 1797 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:10.922431 1797 catalog_manager.cc:5868] T 00000000000000000000000000000000 P acff7a0d60e54dabba75cf44fc78bdbe: Generated new TSK 0
I20260809 02:25:10.922963 1797 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:10.929867 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1677
W20260809 02:25:10.948514 1652 connection.cc:535] client connection to 127.1.81.254:44789 recv error: Network error: failed to read from TLS socket (remote: 127.1.81.254:44789): Connection reset by peer (error 104)
2026-08-09T02:25:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1476 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:11 dist-test-slave-jlzn krb5kdc[1819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:11 dist-test-slave-jlzn krb5kdc[1819](info): set up 2 sockets
Aug 09 02:25:11 dist-test-slave-jlzn krb5kdc[1819](info): commencing operation
krb5kdc: starting...
W20260809 02:25:12.506052 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.543s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:12 dist-test-slave-jlzn krb5kdc[1819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:25:12.632252 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41783
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:41783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:12.737532 1843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:12.737766 1843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:12.737820 1843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:12.741703 1843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:12.741757 1843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:12.741783 1843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:12.741804 1843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:12.741832 1843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:12.746807 1843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:41783
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:12.747700 1843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:12.748636 1843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:12.756242 1851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:12.756374 1853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:12.756314 1849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:12.756472 1843 server_base.cc:1034] running on GCE node
I20260809 02:25:12.757063 1843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:12.758013 1843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:12.759173 1843 hybrid_clock.cc:648] HybridClock initialized: now 1786242312759165 us; error 29 us; skew 500 ppm
Aug 09 02:25:12 dist-test-slave-jlzn krb5kdc[1819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242312, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:12.766345 1843 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:25:12.767138 1843 webserver.cc:460] Webserver started at http://127.1.81.254:34357/ using document root <none> and password file <none>
I20260809 02:25:12.767617 1843 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:12.767684 1843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:12.767907 1843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:12.769729 1843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "ae79ab13bc1441ce91990d622f6bedbf"
format_stamp: "Formatted at 2026-08-09 02:25:12 on dist-test-slave-jlzn"
server_key: "6a10d1e52094e677cba245d80a6d74b0"
server_key_iv: "831b1d7f5604139d2e5f61fc6f4a7244"
server_key_version: "encryptionkey@0"
I20260809 02:25:12.770253 1843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "ae79ab13bc1441ce91990d622f6bedbf"
format_stamp: "Formatted at 2026-08-09 02:25:12 on dist-test-slave-jlzn"
server_key: "6a10d1e52094e677cba245d80a6d74b0"
server_key_iv: "831b1d7f5604139d2e5f61fc6f4a7244"
server_key_version: "encryptionkey@0"
I20260809 02:25:12.773623 1843 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:25:12.775699 1867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:12.776775 1843 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:12.776887 1843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "ae79ab13bc1441ce91990d622f6bedbf"
format_stamp: "Formatted at 2026-08-09 02:25:12 on dist-test-slave-jlzn"
server_key: "6a10d1e52094e677cba245d80a6d74b0"
server_key_iv: "831b1d7f5604139d2e5f61fc6f4a7244"
server_key_version: "encryptionkey@0"
I20260809 02:25:12.776973 1843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:12.781133 1843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:12.783557 1843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:12.783716 1843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:12.790167 1843 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:41783
I20260809 02:25:12.790179 1944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:41783 every 8 connection(s)
I20260809 02:25:12.790951 1843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:12.793659 1947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:12.796984 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 1843
I20260809 02:25:12.797112 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:12.797369 1351 external_mini_cluster.cc:1428] Setting key 403afbcf0abecc5de1886ff220475e9a
I20260809 02:25:12.798956 1947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf: Bootstrap starting.
I20260809 02:25:12.801265 1947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:12.801990 1947 log.cc:824] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:12.802124 1954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:12.798605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37245 (local address 127.1.81.254:41783)
0809 02:25:12.798990 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:12.799004 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:12.799045 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:25:12.799655 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:12.799671 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:12.799968 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:12.800230 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:12.801009 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:12.801013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:12.801025 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:12.801035 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:12.801088 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:12.801106 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:12.801190 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:12.801319 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 02:25:12.801468 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":95,"threads_started":1}
I20260809 02:25:12.803731 1947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf: No bootstrap required, opened a new log
I20260809 02:25:12.804629 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:12.807350 1947 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79ab13bc1441ce91990d622f6bedbf" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41783 } }
I20260809 02:25:12.807554 1947 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:12.807626 1947 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae79ab13bc1441ce91990d622f6bedbf, State: Initialized, Role: FOLLOWER
I20260809 02:25:12.808063 1954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:12.806529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57613 (local address 127.1.81.254:41783)
0809 02:25:12.806643 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:12.806647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:12.806829 (+ 182us) server_negotiation.cc:407] Connection header received
0809 02:25:12.806914 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:12.806917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:12.806949 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:12.807034 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:12.807593 (+ 559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:12.807596 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:12.807599 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:12.807620 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:12.807647 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:12.807661 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:12.807744 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:12.807921 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:25:12.807958 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:25:12.808094 1947 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79ab13bc1441ce91990d622f6bedbf" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41783 } }
I20260809 02:25:12.808252 1947 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:12.808323 1947 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:12.808421 1947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:12.809437 1947 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79ab13bc1441ce91990d622f6bedbf" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41783 } }
I20260809 02:25:12.809770 1947 leader_election.cc:302] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae79ab13bc1441ce91990d622f6bedbf; no voters:
I20260809 02:25:12.810050 1947 leader_election.cc:288] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:12.810127 1962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:12.810364 1962 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [term 1 LEADER]: Becoming Leader. State: Replica: ae79ab13bc1441ce91990d622f6bedbf, State: Running, Role: LEADER
I20260809 02:25:12.810856 1962 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79ab13bc1441ce91990d622f6bedbf" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41783 } }
I20260809 02:25:12.811362 1947 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:12.811910 1962 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae79ab13bc1441ce91990d622f6bedbf. Latest consensus state: current_term: 1 leader_uuid: "ae79ab13bc1441ce91990d622f6bedbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79ab13bc1441ce91990d622f6bedbf" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41783 } } }
I20260809 02:25:12.812086 1962 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:12.812301 1964 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae79ab13bc1441ce91990d622f6bedbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79ab13bc1441ce91990d622f6bedbf" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41783 } } }
I20260809 02:25:12.812397 1964 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:12.812553 1975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:12.815503 1975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:12.820966 1975 catalog_manager.cc:1347] Generated new cluster ID: 49fa6df008564378a59ec29260a44d97
I20260809 02:25:12.821017 1975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:12.841431 1975 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:12.841759 1975 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:12.856676 1975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae79ab13bc1441ce91990d622f6bedbf: Generated new TSK 0
I20260809 02:25:12.857347 1975 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:12.860518 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 1843
2026-08-09T02:25:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1935 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:12 dist-test-slave-jlzn krb5kdc[1996](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:12 dist-test-slave-jlzn krb5kdc[1996](info): set up 2 sockets
Aug 09 02:25:12 dist-test-slave-jlzn krb5kdc[1996](info): commencing operation
krb5kdc: starting...
W20260809 02:25:14.002234 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:14 dist-test-slave-jlzn krb5kdc[1996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:25:14.112598 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44139
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:44929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:44139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:14.217964 2014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:14.218195 2014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:14.218251 2014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:14.222091 2014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:14.222153 2014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:14.222180 2014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:14.222208 2014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:14.222237 2014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:14.227111 2014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:44929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:44139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:44139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:14.227985 2014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:14.228844 2014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:14.236573 2019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:14.236636 2022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:14.236598 2020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:14.236724 2014 server_base.cc:1034] running on GCE node
I20260809 02:25:14.237371 2014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:14.238330 2014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:14.239524 2014 hybrid_clock.cc:648] HybridClock initialized: now 1786242314239509 us; error 28 us; skew 500 ppm
Aug 09 02:25:14 dist-test-slave-jlzn krb5kdc[1996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242314, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:14.242108 2014 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:25:14.242908 2014 webserver.cc:460] Webserver started at http://127.1.81.254:41969/ using document root <none> and password file <none>
I20260809 02:25:14.243383 2014 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:14.243448 2014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:14.243652 2014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:14.245523 2014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "151c0ce4869943b5b37761a57b6137bd"
format_stamp: "Formatted at 2026-08-09 02:25:14 on dist-test-slave-jlzn"
server_key: "32bf8cd5711d2ca28a37fdd12b542517"
server_key_iv: "56376be98b703474aabf594aa481cdb3"
server_key_version: "encryptionkey@0"
I20260809 02:25:14.246042 2014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "151c0ce4869943b5b37761a57b6137bd"
format_stamp: "Formatted at 2026-08-09 02:25:14 on dist-test-slave-jlzn"
server_key: "32bf8cd5711d2ca28a37fdd12b542517"
server_key_iv: "56376be98b703474aabf594aa481cdb3"
server_key_version: "encryptionkey@0"
I20260809 02:25:14.249405 2014 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:25:14.251502 2030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:14.252614 2014 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:14.252738 2014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "151c0ce4869943b5b37761a57b6137bd"
format_stamp: "Formatted at 2026-08-09 02:25:14 on dist-test-slave-jlzn"
server_key: "32bf8cd5711d2ca28a37fdd12b542517"
server_key_iv: "56376be98b703474aabf594aa481cdb3"
server_key_version: "encryptionkey@0"
I20260809 02:25:14.252825 2014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:14.269979 2014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:14.272379 2014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:14.272538 2014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:14.278944 2014 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:44139
I20260809 02:25:14.278954 2113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:44139 every 8 connection(s)
I20260809 02:25:14.279762 2014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:14.282264 2114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:14.287209 2114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd: Bootstrap starting.
I20260809 02:25:14.287494 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2014
I20260809 02:25:14.287642 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:14.287914 1351 external_mini_cluster.cc:1428] Setting key 1895a6ff5b370688a01dd7fb017e0f3d
I20260809 02:25:14.289567 2114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:14.290244 2114 log.cc:824] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:14.292254 2114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd: No bootstrap required, opened a new log
I20260809 02:25:14.296278 2114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151c0ce4869943b5b37761a57b6137bd" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44139 } }
I20260809 02:25:14.296473 2114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:14.296519 2114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 151c0ce4869943b5b37761a57b6137bd, State: Initialized, Role: FOLLOWER
Aug 09 02:25:14 dist-test-slave-jlzn krb5kdc[1996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:25:14.296909 2114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151c0ce4869943b5b37761a57b6137bd" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44139 } }
I20260809 02:25:14.297037 2114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:14.297103 2114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:14.297204 2114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:14.297986 2114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151c0ce4869943b5b37761a57b6137bd" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44139 } }
I20260809 02:25:14.298300 2114 leader_election.cc:302] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 151c0ce4869943b5b37761a57b6137bd; no voters:
I20260809 02:25:14.298568 2114 leader_election.cc:288] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:14.298657 2121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:14.298837 2121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [term 1 LEADER]: Becoming Leader. State: Replica: 151c0ce4869943b5b37761a57b6137bd, State: Running, Role: LEADER
I20260809 02:25:14.299162 2121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151c0ce4869943b5b37761a57b6137bd" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44139 } }
I20260809 02:25:14.299726 2114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:14.300756 2123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "151c0ce4869943b5b37761a57b6137bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151c0ce4869943b5b37761a57b6137bd" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44139 } } }
I20260809 02:25:14.300876 2123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:14.301348 2124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 151c0ce4869943b5b37761a57b6137bd. Latest consensus state: current_term: 1 leader_uuid: "151c0ce4869943b5b37761a57b6137bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151c0ce4869943b5b37761a57b6137bd" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 44139 } } }
I20260809 02:25:14.301990 2124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:14.302389 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:14.289084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45561 (local address 127.1.81.254:44139)
0809 02:25:14.289500 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:14.289515 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:14.289549 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:25:14.290168 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:14.290185 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:14.290509 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:14.290851 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:14.291677 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:14.292717 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:14.293896 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:14.294341 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:14.294456 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:14.297125 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:14.297132 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:14.297147 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:14.297180 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:14.298851 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:14.299354 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:14.299360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:14.299365 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:14.299478 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:14.299744 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:14.299747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:14.299749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:14.300153 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:14.300916 (+ 763us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:14.301061 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 02:25:14.301330 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":121,"threads_started":1}
W20260809 02:25:14.304747 2147 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:14.304826 2147 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:14.304850 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:14.304939 2134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:14.305809 2134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:14.311383 2134 catalog_manager.cc:1347] Generated new cluster ID: 8313305668cb444eb10b10f5b8c50d3b
I20260809 02:25:14.311445 2134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:14.315837 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:14.307038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33023 (local address 127.1.81.254:44139)
0809 02:25:14.307156 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:14.307160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:14.309483 (+ 2323us) server_negotiation.cc:407] Connection header received
0809 02:25:14.309586 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:14.309589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:14.309634 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:14.309711 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:14.310312 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:14.310808 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:14.311622 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:14.311895 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:14.311983 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:14.313122 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:14.313126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:14.313128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:14.313160 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:14.314370 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:14.314767 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:14.314770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:14.314773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:14.314845 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:14.315083 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:14.315086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:14.315088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:14.315252 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:14.315372 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:14.315589 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 02:25:14.315687 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:25:14.328058 2134 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:14.329099 2134 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:14.335878 2134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 151c0ce4869943b5b37761a57b6137bd: Generated new TSK 0
I20260809 02:25:14.336385 2134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:14.341487 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2014
2026-08-09T02:25:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1477 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:14 dist-test-slave-jlzn krb5kdc[2161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:14 dist-test-slave-jlzn krb5kdc[2161](info): set up 2 sockets
Aug 09 02:25:14 dist-test-slave-jlzn krb5kdc[2161](info): commencing operation
krb5kdc: starting...
W20260809 02:25:15.462229 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:15 dist-test-slave-jlzn krb5kdc[2161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:25:15.572471 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:35713
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:46137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:35713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:15.677125 2186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:15.677352 2186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:15.677407 2186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:15.681223 2186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:15.681274 2186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:15.681301 2186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:15.681324 2186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:15.681351 2186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:15.686264 2186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:46137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:35713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:35713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:15.687098 2186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:15.687994 2186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:15.695606 2194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:15.695740 2186 server_base.cc:1034] running on GCE node
W20260809 02:25:15.695696 2197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:15.695638 2193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:15.696328 2186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:15.697253 2186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:15.698402 2186 hybrid_clock.cc:648] HybridClock initialized: now 1786242315698385 us; error 28 us; skew 500 ppm
Aug 09 02:25:15 dist-test-slave-jlzn krb5kdc[2161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242315, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:15.700896 2186 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:25:15.701653 2186 webserver.cc:460] Webserver started at http://127.1.81.254:34609/ using document root <none> and password file <none>
I20260809 02:25:15.702106 2186 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:15.702170 2186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:15.702339 2186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:15.704156 2186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "32d9d00e266f46b181e852768bf799fc"
format_stamp: "Formatted at 2026-08-09 02:25:15 on dist-test-slave-jlzn"
server_key: "fb8b3f37714ca5683e81f30abcf9339c"
server_key_iv: "8596b2637fd8fe873d7fb29fd2cde940"
server_key_version: "encryptionkey@0"
I20260809 02:25:15.704658 2186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "32d9d00e266f46b181e852768bf799fc"
format_stamp: "Formatted at 2026-08-09 02:25:15 on dist-test-slave-jlzn"
server_key: "fb8b3f37714ca5683e81f30abcf9339c"
server_key_iv: "8596b2637fd8fe873d7fb29fd2cde940"
server_key_version: "encryptionkey@0"
I20260809 02:25:15.707860 2186 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:25:15.709924 2204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:15.710968 2186 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:15.711076 2186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "32d9d00e266f46b181e852768bf799fc"
format_stamp: "Formatted at 2026-08-09 02:25:15 on dist-test-slave-jlzn"
server_key: "fb8b3f37714ca5683e81f30abcf9339c"
server_key_iv: "8596b2637fd8fe873d7fb29fd2cde940"
server_key_version: "encryptionkey@0"
I20260809 02:25:15.711159 2186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:15.726450 2186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:15.729140 2186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:15.729296 2186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:15.735471 2186 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:35713
I20260809 02:25:15.735517 2278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:35713 every 8 connection(s)
I20260809 02:25:15.736320 2186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:15.736995 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2186
I20260809 02:25:15.737133 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:15.737444 1351 external_mini_cluster.cc:1428] Setting key d1a1151d5b668f4214abd92096d319b6
I20260809 02:25:15.739306 2281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:15.745179 2281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc: Bootstrap starting.
I20260809 02:25:15.745533 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:15.738651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33765 (local address 127.1.81.254:35713)
0809 02:25:15.739028 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:15.739043 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:15.739076 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:25:15.739687 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:15.739704 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:15.740046 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:15.740302 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:15.740614 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:15.741549 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:15.742738 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:15.743165 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:15.743277 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:15.744040 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:15.744045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:15.744056 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:15.744384 (+ 328us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:15.744434 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:15.744454 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:15.744526 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:15.744685 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 02:25:15.744864 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":110,"threads_started":1}
I20260809 02:25:15.747433 2281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:15.748143 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:15.748281 2281 log.cc:824] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:15.750385 2281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc: No bootstrap required, opened a new log
I20260809 02:25:15.753854 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:15.750275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50335 (local address 127.1.81.254:35713)
0809 02:25:15.750383 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:15.750387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:15.750527 (+ 140us) server_negotiation.cc:407] Connection header received
0809 02:25:15.750624 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:15.750627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:15.750670 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:15.750755 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:15.750942 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:15.751651 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:15.752433 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:15.752768 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:15.752874 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:15.753483 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:15.753487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:15.753490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:15.753503 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:15.753530 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:15.753543 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:15.753611 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:15.753677 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 02:25:15.753723 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:25:15.754525 2281 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9d00e266f46b181e852768bf799fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35713 } }
I20260809 02:25:15.754741 2281 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:15.754793 2281 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d9d00e266f46b181e852768bf799fc, State: Initialized, Role: FOLLOWER
I20260809 02:25:15.755187 2281 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9d00e266f46b181e852768bf799fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35713 } }
I20260809 02:25:15.755313 2281 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:15.755378 2281 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:15.755468 2281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:15.756310 2281 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9d00e266f46b181e852768bf799fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35713 } }
I20260809 02:25:15.756620 2281 leader_election.cc:302] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32d9d00e266f46b181e852768bf799fc; no voters:
I20260809 02:25:15.756912 2281 leader_election.cc:288] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:15.756978 2297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:15.757189 2297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [term 1 LEADER]: Becoming Leader. State: Replica: 32d9d00e266f46b181e852768bf799fc, State: Running, Role: LEADER
I20260809 02:25:15.757531 2297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9d00e266f46b181e852768bf799fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35713 } }
I20260809 02:25:15.757987 2281 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:15.759122 2299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32d9d00e266f46b181e852768bf799fc. Latest consensus state: current_term: 1 leader_uuid: "32d9d00e266f46b181e852768bf799fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9d00e266f46b181e852768bf799fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35713 } } }
I20260809 02:25:15.759162 2298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32d9d00e266f46b181e852768bf799fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9d00e266f46b181e852768bf799fc" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35713 } } }
I20260809 02:25:15.759343 2299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:15.759362 2298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:15.759822 2312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:15.762676 2312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:15.767625 2312 catalog_manager.cc:1347] Generated new cluster ID: e1020681185b41da9eb08002ac1258c7
I20260809 02:25:15.767685 2312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:15.777586 2312 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:15.778676 2312 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:15.791567 2312 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32d9d00e266f46b181e852768bf799fc: Generated new TSK 0
I20260809 02:25:15.792286 2312 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:15.796963 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2186
2026-08-09T02:25:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:15 dist-test-slave-jlzn krb5kdc[2326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:15 dist-test-slave-jlzn krb5kdc[2326](info): set up 2 sockets
Aug 09 02:25:15 dist-test-slave-jlzn krb5kdc[2326](info): commencing operation
krb5kdc: starting...
W20260809 02:25:16.927764 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:17 dist-test-slave-jlzn krb5kdc[2326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:25:17.038664 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:33621
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:33621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:17.143482 2344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:17.143708 2344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:17.143765 2344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:17.147641 2344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:17.147696 2344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:17.147722 2344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:17.147745 2344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:17.147773 2344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:17.152736 2344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:33621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:33621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:17.153604 2344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:17.154479 2344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:17.162251 2351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:17.162303 2353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:17.162357 2350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:17.162453 2344 server_base.cc:1034] running on GCE node
I20260809 02:25:17.162942 2344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:17.163923 2344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:17.165072 2344 hybrid_clock.cc:648] HybridClock initialized: now 1786242317165058 us; error 25 us; skew 500 ppm
Aug 09 02:25:17 dist-test-slave-jlzn krb5kdc[2326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242317, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:17.167620 2344 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:25:17.168390 2344 webserver.cc:460] Webserver started at http://127.1.81.254:40835/ using document root <none> and password file <none>
I20260809 02:25:17.168848 2344 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:17.168901 2344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:17.169065 2344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:17.170852 2344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "9c4c8708212c4da78fc4671cf3616197"
format_stamp: "Formatted at 2026-08-09 02:25:17 on dist-test-slave-jlzn"
server_key: "6749bc3b41d8b43e2f6c9afdce23ff9c"
server_key_iv: "abc12e67934112bbacbfb3e7662a2e25"
server_key_version: "encryptionkey@0"
I20260809 02:25:17.171324 2344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "9c4c8708212c4da78fc4671cf3616197"
format_stamp: "Formatted at 2026-08-09 02:25:17 on dist-test-slave-jlzn"
server_key: "6749bc3b41d8b43e2f6c9afdce23ff9c"
server_key_iv: "abc12e67934112bbacbfb3e7662a2e25"
server_key_version: "encryptionkey@0"
I20260809 02:25:17.174635 2344 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 02:25:17.176730 2365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:17.177767 2344 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:17.177865 2344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "9c4c8708212c4da78fc4671cf3616197"
format_stamp: "Formatted at 2026-08-09 02:25:17 on dist-test-slave-jlzn"
server_key: "6749bc3b41d8b43e2f6c9afdce23ff9c"
server_key_iv: "abc12e67934112bbacbfb3e7662a2e25"
server_key_version: "encryptionkey@0"
I20260809 02:25:17.177940 2344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:17.181981 2344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:17.184712 2344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:17.184846 2344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:17.190991 2344 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:33621
I20260809 02:25:17.191004 2441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:33621 every 8 connection(s)
I20260809 02:25:17.191787 2344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:17.193177 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2344
I20260809 02:25:17.193321 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:17.193596 1351 external_mini_cluster.cc:1428] Setting key 4d6396116bf29e140546b0d7e409d5b6
I20260809 02:25:17.194643 2444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:17.198108 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:17.194782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60989 (local address 127.1.81.254:33621)
0809 02:25:17.195159 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:17.195174 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:17.195206 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:25:17.195776 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:17.195791 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:17.196089 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:17.196341 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:17.197056 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:17.197061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:17.197072 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:17.197081 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:17.197129 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:17.197149 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:17.197250 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:17.197344 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 02:25:17.197469 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":119,"threads_started":1}
I20260809 02:25:17.200147 2444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197: Bootstrap starting.
I20260809 02:25:17.200610 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:17.202555 2444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:17.203447 2444 log.cc:824] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:17.204236 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:17.202715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32819 (local address 127.1.81.254:33621)
0809 02:25:17.202836 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:17.202840 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:17.203006 (+ 166us) server_negotiation.cc:407] Connection header received
0809 02:25:17.203122 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:17.203125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:17.203166 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:17.203226 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:17.203891 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:17.203895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:17.203897 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:17.203909 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:17.203932 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:17.203945 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:17.204028 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:17.204093 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:25:17.204127 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:25:17.205381 2444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197: No bootstrap required, opened a new log
I20260809 02:25:17.208607 2444 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c8708212c4da78fc4671cf3616197" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 33621 } }
I20260809 02:25:17.208794 2444 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:17.208832 2444 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4c8708212c4da78fc4671cf3616197, State: Initialized, Role: FOLLOWER
I20260809 02:25:17.209174 2444 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c8708212c4da78fc4671cf3616197" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 33621 } }
I20260809 02:25:17.209290 2444 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:17.209334 2444 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:17.209400 2444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:17.210107 2444 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c8708212c4da78fc4671cf3616197" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 33621 } }
I20260809 02:25:17.210400 2444 leader_election.cc:302] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c4c8708212c4da78fc4671cf3616197; no voters:
I20260809 02:25:17.210661 2444 leader_election.cc:288] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:17.210747 2455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:17.210927 2455 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [term 1 LEADER]: Becoming Leader. State: Replica: 9c4c8708212c4da78fc4671cf3616197, State: Running, Role: LEADER
I20260809 02:25:17.211198 2455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c8708212c4da78fc4671cf3616197" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 33621 } }
I20260809 02:25:17.211849 2444 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:17.213096 2456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c4c8708212c4da78fc4671cf3616197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c8708212c4da78fc4671cf3616197" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 33621 } } }
I20260809 02:25:17.213261 2456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:17.213496 2457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c4c8708212c4da78fc4671cf3616197. Latest consensus state: current_term: 1 leader_uuid: "9c4c8708212c4da78fc4671cf3616197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c8708212c4da78fc4671cf3616197" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 33621 } } }
I20260809 02:25:17.213587 2457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197 [sys.catalog]: This master's current role is: LEADER
W20260809 02:25:17.216137 2482 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:17.216202 2482 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:17.216308 2473 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:17.217191 2473 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:17.221889 2473 catalog_manager.cc:1347] Generated new cluster ID: cf5dca21456b48f9bf0849a680c68db9
I20260809 02:25:17.221951 2473 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:17.240060 2473 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:17.240314 2473 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:17.247447 2473 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c4c8708212c4da78fc4671cf3616197: Generated new TSK 0
I20260809 02:25:17.247990 2473 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:17.254377 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2344
2026-08-09T02:25:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1454 ms)
[----------] 18 tests from AuthTokenIssuingTest (26952 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:17 dist-test-slave-jlzn krb5kdc[2487](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:17 dist-test-slave-jlzn krb5kdc[2487](info): set up 2 sockets
Aug 09 02:25:17 dist-test-slave-jlzn krb5kdc[2487](info): commencing operation
krb5kdc: starting...
W20260809 02:25:18.377417 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:18 dist-test-slave-jlzn krb5kdc[2487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:25:18.488276 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41165
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:36751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:41165,127.1.81.253:39571,127.1.81.252:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:18.592391 2510 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:25:18.592617 2510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:18.592638 2510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:18.592680 2510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:18.596452 2510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:18.596493 2510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:18.596511 2510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:18.596530 2510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:18.596544 2510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:18.601375 2510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:36751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:41165,127.1.81.253:39571,127.1.81.252:42505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:41165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:18.602164 2510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:18.602969 2510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:18.610579 2522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:18.610734 2510 server_base.cc:1034] running on GCE node
W20260809 02:25:18.610567 2519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:18.610554 2524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:18.611402 2510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:18.612462 2510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:18.613617 2510 hybrid_clock.cc:648] HybridClock initialized: now 1786242318613600 us; error 30 us; skew 500 ppm
Aug 09 02:25:18 dist-test-slave-jlzn krb5kdc[2487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:18.619789 2510 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:25:18.620675 2510 webserver.cc:460] Webserver started at http://127.1.81.254:44849/ using document root <none> and password file <none>
I20260809 02:25:18.621162 2510 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:18.621228 2510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:18.621399 2510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:18.623257 2510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23"
format_stamp: "Formatted at 2026-08-09 02:25:18 on dist-test-slave-jlzn"
server_key: "b3e152521266004ca48120aa29d508f7"
server_key_iv: "dfab40669ba65e342c29e38a8a183cff"
server_key_version: "encryptionkey@0"
I20260809 02:25:18.623764 2510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23"
format_stamp: "Formatted at 2026-08-09 02:25:18 on dist-test-slave-jlzn"
server_key: "b3e152521266004ca48120aa29d508f7"
server_key_iv: "dfab40669ba65e342c29e38a8a183cff"
server_key_version: "encryptionkey@0"
I20260809 02:25:18.627023 2510 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260809 02:25:18.629240 2532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:18.630276 2510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:18.630388 2510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23"
format_stamp: "Formatted at 2026-08-09 02:25:18 on dist-test-slave-jlzn"
server_key: "b3e152521266004ca48120aa29d508f7"
server_key_iv: "dfab40669ba65e342c29e38a8a183cff"
server_key_version: "encryptionkey@0"
I20260809 02:25:18.630472 2510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:18.652988 2510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:18.655268 2510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:18.655426 2510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:18.661608 2510 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:41165
I20260809 02:25:18.661856 2606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:41165 every 8 connection(s)
I20260809 02:25:18.662420 2510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:18.663096 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2510
I20260809 02:25:18.663220 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:18.663482 1351 external_mini_cluster.cc:1428] Setting key 99cb7878384c2a668eab0a8003ff22dd
I20260809 02:25:18.665512 2607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:18.668876 2607 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.81.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.253@KRBTEST.COM" created.
Aug 09 02:25:18 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:25:18.682745 2612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.670833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46220 (local address 127.1.81.254:41165)
0809 02:25:18.671194 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:18.671211 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:18.671449 (+ 238us) server_negotiation.cc:407] Connection header received
0809 02:25:18.672441 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:18.672446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:18.672603 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:18.672763 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:18.673519 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.674396 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.675348 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.675781 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.675921 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:18.678396 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:18.678401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:18.678410 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:18.678435 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:18.680152 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:18.680587 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:18.680592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:18.680595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:18.680754 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:18.681020 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:18.681023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:18.681024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:18.681461 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:18.681594 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:18.681905 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 02:25:18.682103 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":239,"thread_start_us":103,"threads_started":1}
I20260809 02:25:18.682744 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.670833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41165 (local address 127.0.0.1:46220)
0809 02:25:18.671323 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.671356 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:18.672176 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:18.672785 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:18.672789 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:18.673165 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:18.673384 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:18.673396 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.674525 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.674528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:18.675226 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:18.675236 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.675941 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.675945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:18.676066 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:18.676554 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:18.676575 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:18.678254 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:18.680255 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:18.680264 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:18.680271 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:18.680483 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:18.680840 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:18.680842 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:18.680843 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:18.680938 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:18.681565 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:18.681569 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:18.681678 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 02:25:18.681798 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 02:25:18.682037 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"spinlock_wait_cycles":2816,"thread_start_us":151,"threads_started":1}
I20260809 02:25:18.684726 2607 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:18.685298 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.685077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59604)
0809 02:25:18.685186 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.685250 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 02:25:18.685477 2536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
I20260809 02:25:18.686218 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.686027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59616)
0809 02:25:18.686124 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.686169 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 02:25:18.686335 2607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:39571: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab.
Entry for principal kudu/127.1.81.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab.
I20260809 02:25:18.688340 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.253:39571
--webserver_interface=127.1.81.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab
--principal=kudu/127.1.81.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:36751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:41165,127.1.81.253:39571,127.1.81.252:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:25:18.735545 2607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } attempt: 1
I20260809 02:25:18.736186 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.735964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59626)
0809 02:25:18.736078 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.736126 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 02:25:18.736799 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.736600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59632)
0809 02:25:18.736705 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.736746 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 02:25:18.736919 2607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:39571: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
W20260809 02:25:18.792866 2616 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:25:18.793108 2616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:18.793152 2616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:18.793207 2616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:18.797072 2616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:18.797119 2616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:18.797145 2616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:18.797168 2616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:18.797195 2616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:18.802088 2616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:36751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:41165,127.1.81.253:39571,127.1.81.252:42505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab
--principal=kudu/127.1.81.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.253:39571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.81.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:18.802946 2616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:18.803864 2616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:18.805058 2607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } attempt: 2
I20260809 02:25:18.805730 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.805451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59634)
0809 02:25:18.805582 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.805636 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 02:25:18.806455 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.806247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59646)
0809 02:25:18.806353 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.806397 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 02:25:18.806561 2607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:39571: Network error: Client connection negotiation failed: client connection to 127.1.81.253:39571: connect: Connection refused (error 111)
W20260809 02:25:18.811826 2628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:18.811842 2624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:18.811915 2621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:18.811983 2616 server_base.cc:1034] running on GCE node
I20260809 02:25:18.812651 2616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:18.813592 2616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:18.814744 2616 hybrid_clock.cc:648] HybridClock initialized: now 1786242318814729 us; error 28 us; skew 500 ppm
Aug 09 02:25:18 dist-test-slave-jlzn krb5kdc[2487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:18.817299 2616 init.cc:377] Logged in from keytab as kudu/127.1.81.253@KRBTEST.COM (short username kudu)
I20260809 02:25:18.818089 2616 webserver.cc:460] Webserver started at http://127.1.81.253:38983/ using document root <none> and password file <none>
I20260809 02:25:18.818600 2616 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:18.818667 2616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:18.818842 2616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:18.820870 2616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/data/instance:
uuid: "96189380460845f09d803c0f1fe24137"
format_stamp: "Formatted at 2026-08-09 02:25:18 on dist-test-slave-jlzn"
server_key: "b5250a0a48a04b938f391f95a1878e9b"
server_key_iv: "a73d46a0777f7e4b25e9167e42a52666"
server_key_version: "encryptionkey@0"
I20260809 02:25:18.821380 2616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/wal/instance:
uuid: "96189380460845f09d803c0f1fe24137"
format_stamp: "Formatted at 2026-08-09 02:25:18 on dist-test-slave-jlzn"
server_key: "b5250a0a48a04b938f391f95a1878e9b"
server_key_iv: "a73d46a0777f7e4b25e9167e42a52666"
server_key_version: "encryptionkey@0"
I20260809 02:25:18.824813 2616 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 02:25:18.826968 2639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:18.828074 2616 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:18.828202 2616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/wal
uuid: "96189380460845f09d803c0f1fe24137"
format_stamp: "Formatted at 2026-08-09 02:25:18 on dist-test-slave-jlzn"
server_key: "b5250a0a48a04b938f391f95a1878e9b"
server_key_iv: "a73d46a0777f7e4b25e9167e42a52666"
server_key_version: "encryptionkey@0"
I20260809 02:25:18.828289 2616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:18.851655 2616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:18.854058 2616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:18.854224 2616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:18.860612 2616 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.253:39571
I20260809 02:25:18.860862 2704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.253:39571 every 8 connection(s)
I20260809 02:25:18.861435 2616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
I20260809 02:25:18.863201 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2616
I20260809 02:25:18.863323 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-1/wal/instance
I20260809 02:25:18.863615 1351 external_mini_cluster.cc:1428] Setting key 9f0f2020628a61b9a51335bf8bada4b1
I20260809 02:25:18.864183 2707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:18.868592 2707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.81.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.252@KRBTEST.COM" created.
Aug 09 02:25:18 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:25:18.881392 2612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.870430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46236 (local address 127.1.81.254:41165)
0809 02:25:18.870567 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:18.870573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:18.871296 (+ 723us) server_negotiation.cc:407] Connection header received
0809 02:25:18.872253 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:18.872257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:18.872319 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:18.872420 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:18.873435 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.873993 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.875085 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.875354 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.875456 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:18.877795 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:18.877798 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:18.877800 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:18.877823 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:18.879338 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:18.879904 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:18.879908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:18.879910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:18.880001 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:18.880314 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:18.880317 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:18.880319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:18.880551 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:18.880656 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:18.881092 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 02:25:18.881233 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:25:18.881939 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.870710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41165 (local address 127.0.0.1:46236)
0809 02:25:18.871142 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.871192 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:18.872055 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:18.872535 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:18.872542 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:18.872838 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:18.873300 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:18.873315 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.874091 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.874093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:18.874976 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:18.874987 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.875477 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.875479 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:18.875650 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:18.876155 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:18.876175 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:18.877634 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:18.879448 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:18.879453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:18.879464 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:18.879765 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:18.880085 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:18.880087 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:18.880089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:18.880215 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:18.880646 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:18.880650 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:18.880852 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 02:25:18.880986 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 02:25:18.881200 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":95,"threads_started":1}
I20260809 02:25:18.883178 2707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:25:18 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab.
Entry for principal kudu/127.1.81.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab.
I20260809 02:25:18.890375 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.252:42505
--webserver_interface=127.1.81.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab
--principal=kudu/127.1.81.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:36751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:41165,127.1.81.253:39571,127.1.81.252:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:25:18.891242 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.883609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59658)
0809 02:25:18.883707 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.883720 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:18.883782 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:18.884290 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:18.884293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:18.884446 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:18.884514 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:18.884520 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.885542 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.885545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:18.886048 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:18.886056 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.886591 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.886594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:18.886696 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:18.887070 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:18.887083 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:18.888192 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:18.889844 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:18.889847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:18.889849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:18.890023 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:18.890283 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:18.890286 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:18.890288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:18.890363 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:18.890801 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:18.890804 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:18.890894 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 02:25:18.890981 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 02:25:18.891097 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":3}
I20260809 02:25:18.891363 2715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.883692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59658 (local address 127.1.81.253:39571)
0809 02:25:18.883987 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:18.884001 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:18.884020 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:25:18.884052 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:18.884056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:18.884182 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:18.884290 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:18.884613 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.885434 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.886149 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.886487 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.886590 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:18.888309 (+ 1719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:18.888319 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:18.888331 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:18.888353 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:18.889742 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:18.890118 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:18.890124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:18.890126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:18.890203 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:18.890437 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:18.890440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:18.890441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:18.890698 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:18.890818 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:18.891075 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 02:25:18.891194 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":207,"thread_start_us":131,"threads_started":1}
I20260809 02:25:18.893116 2707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:18.893745 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.893500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36414)
0809 02:25:18.893625 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.893691 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 02:25:18.893961 2641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
I20260809 02:25:18.894759 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.894566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36428)
0809 02:25:18.894666 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.894710 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:25:18.894891 2707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:42505: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
I20260809 02:25:18.897707 2607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } attempt: 3
Aug 09 02:25:18 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
I20260809 02:25:18.905470 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.898108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59674)
0809 02:25:18.898224 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.898238 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:18.898326 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:18.898554 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:18.898557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:18.898704 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:18.898783 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:18.898788 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.899479 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.899483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:18.900486 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:18.900497 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.900947 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.900951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:18.901047 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:18.901429 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:18.901440 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:18.902691 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:18.904175 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:18.904178 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:18.904180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:18.904360 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:18.904606 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:18.904609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:18.904611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:18.904688 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:18.905015 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:18.905019 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:18.905106 (+ 87us) client_negotiation.cc:769] Sending connection context
0809 02:25:18.905191 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:25:18.905316 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 02:25:18.905470 2715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.898150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59674 (local address 127.1.81.253:39571)
0809 02:25:18.898235 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:18.898239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:18.898298 (+ 59us) server_negotiation.cc:407] Connection header received
0809 02:25:18.898411 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:18.898414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:18.898451 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:18.898508 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:18.898888 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.899379 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.900611 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:18.900849 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:18.900935 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:18.902814 (+ 1879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:18.902817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:18.902820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:18.902843 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:18.904074 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:18.904447 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:18.904451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:18.904452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:18.904522 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:18.904768 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:18.904772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:18.904773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:18.904924 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:18.905006 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:18.905255 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 02:25:18.905347 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:25:18.906898 2607 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:18.907451 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.907254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36440)
0809 02:25:18.907353 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.907400 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 02:25:18.908093 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.907878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36456)
0809 02:25:18.907999 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.908046 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 02:25:18.908195 2607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:42505: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
I20260809 02:25:18.939321 2607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } attempt: 1
I20260809 02:25:18.939797 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.939597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36458)
0809 02:25:18.939703 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.939746 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 02:25:18.940402 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.940221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36468)
0809 02:25:18.940311 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.940355 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 02:25:18.940503 2607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:42505: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
I20260809 02:25:18.944088 2707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } attempt: 1
I20260809 02:25:18.944638 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.944436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36482)
0809 02:25:18.944540 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.944586 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 02:25:18.945217 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:18.945029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36498)
0809 02:25:18.945120 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:18.945171 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 02:25:18.945314 2707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:42505: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
W20260809 02:25:18.998291 2716 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:25:18.998522 2716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:18.998565 2716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:18.998620 2716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:19.002488 2716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:19.002538 2716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:19.002563 2716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:19.002586 2716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:19.002615 2716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:19.007604 2716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:36751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:41165,127.1.81.253:39571,127.1.81.252:42505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab
--principal=kudu/127.1.81.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.252:42505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.81.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:19.008607 2716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:19.009459 2716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:19.013446 2707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } attempt: 2
I20260809 02:25:19.014003 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.013792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36508)
0809 02:25:19.013900 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.013948 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:25:19.014577 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.014426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36524)
0809 02:25:19.014491 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.014530 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260809 02:25:19.014678 2707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:42505: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
I20260809 02:25:19.015633 2607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } attempt: 2
I20260809 02:25:19.016162 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.015952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36526)
0809 02:25:19.016053 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.016101 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 02:25:19.016791 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.016591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36534)
0809 02:25:19.016682 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.016729 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 02:25:19.016974 2607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:42505: Network error: Client connection negotiation failed: client connection to 127.1.81.252:42505: connect: Connection refused (error 111)
W20260809 02:25:19.017259 2726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:19.017282 2725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:19.017727 2716 server_base.cc:1034] running on GCE node
W20260809 02:25:19.017904 2728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:19.018451 2716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:19.019392 2716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:19.020533 2716 hybrid_clock.cc:648] HybridClock initialized: now 1786242319020513 us; error 39 us; skew 500 ppm
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242319, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:19.023015 2716 init.cc:377] Logged in from keytab as kudu/127.1.81.252@KRBTEST.COM (short username kudu)
I20260809 02:25:19.023782 2716 webserver.cc:460] Webserver started at http://127.1.81.252:34515/ using document root <none> and password file <none>
I20260809 02:25:19.024283 2716 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:19.024348 2716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:19.024518 2716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:19.026369 2716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/data/instance:
uuid: "0876c07e886a47908b4a3fce20197eff"
format_stamp: "Formatted at 2026-08-09 02:25:19 on dist-test-slave-jlzn"
server_key: "d9ab0439eb3d11746989bee537d9d280"
server_key_iv: "6f49e46249175dfe6ca1fb6d9ada3b9c"
server_key_version: "encryptionkey@0"
I20260809 02:25:19.026870 2716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/wal/instance:
uuid: "0876c07e886a47908b4a3fce20197eff"
format_stamp: "Formatted at 2026-08-09 02:25:19 on dist-test-slave-jlzn"
server_key: "d9ab0439eb3d11746989bee537d9d280"
server_key_iv: "6f49e46249175dfe6ca1fb6d9ada3b9c"
server_key_version: "encryptionkey@0"
I20260809 02:25:19.030268 2716 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:25:19.032557 2737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:19.033666 2716 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:19.033776 2716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/wal
uuid: "0876c07e886a47908b4a3fce20197eff"
format_stamp: "Formatted at 2026-08-09 02:25:19 on dist-test-slave-jlzn"
server_key: "d9ab0439eb3d11746989bee537d9d280"
server_key_iv: "6f49e46249175dfe6ca1fb6d9ada3b9c"
server_key_version: "encryptionkey@0"
I20260809 02:25:19.033859 2716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:19.058872 2716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:19.061604 2716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:19.061761 2716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:19.068202 2716 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.252:42505
I20260809 02:25:19.068463 2816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.252:42505 every 8 connection(s)
I20260809 02:25:19.069013 2716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
I20260809 02:25:19.071449 2817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:19.074827 2817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:19.075981 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 2716
I20260809 02:25:19.076095 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242040541704-1351-0/minicluster-data/master-2/wal/instance
I20260809 02:25:19.076370 1351 external_mini_cluster.cc:1428] Setting key f3812e13c1173b5e43a394cf1df3f8aa
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242319, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
I20260809 02:25:19.087603 2612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.076427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46240 (local address 127.1.81.254:41165)
0809 02:25:19.076567 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.076572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.077404 (+ 832us) server_negotiation.cc:407] Connection header received
0809 02:25:19.078344 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.078347 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.078393 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.078486 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.079425 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.080223 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.081487 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.081784 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.081889 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.084199 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.084203 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.084206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.084234 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.085712 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.086208 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.086212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.086214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.086290 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.086586 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.086589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.086591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.086780 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.086863 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.087337 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.087454 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:25:19.088301 2819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.076765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:41165 (local address 127.0.0.1:46240)
0809 02:25:19.077251 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.077300 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:19.078171 (+ 871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:19.078537 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:19.078543 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:19.078941 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:19.079282 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.079302 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.080318 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.080320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.081365 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.081377 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.081917 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.081920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.082052 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.082521 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:19.082543 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:19.084054 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:19.085813 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.085823 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.085831 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.086111 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.086370 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.086373 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.086375 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.086499 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.086882 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:19.086888 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:19.087129 (+ 241us) client_negotiation.cc:769] Sending connection context
0809 02:25:19.087276 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 02:25:19.087535 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":38,"spinlock_wait_cycles":2432,"thread_start_us":128,"threads_started":1}
I20260809 02:25:19.088310 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.076987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36546 (local address 127.1.81.252:42505)
0809 02:25:19.077343 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.077353 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.077664 (+ 311us) server_negotiation.cc:407] Connection header received
0809 02:25:19.078172 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.078185 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.078373 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.078534 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.079336 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.080510 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.081587 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.082080 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.082156 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.084685 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.084690 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.084698 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.084720 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.086054 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.086448 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.086452 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.086454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.086531 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.086785 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.086789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.086791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.087115 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.087287 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.087506 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.087634 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":279,"thread_start_us":116,"threads_started":1}
I20260809 02:25:19.089373 2817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242319, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:25:19.097121 2819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.089776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:39571 (local address 127.0.0.1:59678)
0809 02:25:19.089925 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.089937 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:19.089997 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:19.090224 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:19.090227 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:19.090376 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:19.090479 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.090486 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.091437 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.091440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.092213 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.092222 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.092755 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.092758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.092821 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.093168 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:19.093182 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:19.094295 (+ 1113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:19.095887 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.095891 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.095892 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.096073 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.096335 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.096338 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.096340 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.096416 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.096753 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:19.096756 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:19.096828 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 02:25:19.096904 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:25:19.096987 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 02:25:19.097205 2715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.089864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59678 (local address 127.1.81.253:39571)
0809 02:25:19.089968 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.089972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.089988 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:25:19.090063 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.090065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.090112 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.090192 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.090604 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.091339 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.092316 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.092660 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.092756 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.094426 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.094429 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.094431 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.094455 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.095775 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.096169 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.096172 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.096173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.096250 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.096499 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.096502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.096504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.096669 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.096764 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.096975 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.097086 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:25:19.097905 2817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:19.098796 2612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.090303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46254 (local address 127.1.81.254:41165)
0809 02:25:19.090419 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.090423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.090456 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:25:19.090537 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.090541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.090581 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.090638 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.091297 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.092012 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.092937 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.093189 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.093292 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.095388 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.095391 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.095392 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.095413 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.096612 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.097048 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.097052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.097054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.097135 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.097720 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.097723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.097724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.097937 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.098132 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.098556 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.098661 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242319, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
I20260809 02:25:19.105816 2707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } attempt: 3
I20260809 02:25:19.106101 2819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.098277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36552)
0809 02:25:19.098435 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.098445 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:19.098511 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:19.098736 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:19.098738 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:19.098879 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:19.098961 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.098967 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.099755 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.099758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.100366 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.100376 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.101487 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.101489 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.101545 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.101927 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:19.101937 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:19.102929 (+ 992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:19.104449 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.104451 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.104453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.104669 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.104914 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.104917 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.104919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.105001 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.105603 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:19.105605 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:19.105703 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 02:25:19.105809 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:25:19.105921 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 02:25:19.106195 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.098353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36552 (local address 127.1.81.252:42505)
0809 02:25:19.098463 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.098468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.098480 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:25:19.098583 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.098586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.098627 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.098697 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.099067 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.099646 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.100476 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.100828 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.100931 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.103056 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.103061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.103063 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.103088 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.104338 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.104762 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.104765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.104766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.104840 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.105080 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.105083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.105085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.105270 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.105361 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.105896 (+ 535us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.106001 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:25:19.108000 2715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.100023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59686 (local address 127.1.81.253:39571)
0809 02:25:19.100133 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.100136 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.100145 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:25:19.100180 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.100182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.100212 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.100273 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.100928 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.101373 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.102197 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.102405 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.102489 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.104864 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.104867 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.104869 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.104894 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.106382 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.106815 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.106818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.106820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.106893 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.107184 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.107188 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.107189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.107374 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.107575 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.107741 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.107870 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:25:19.109614 2817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff: Bootstrap starting.
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
I20260809 02:25:19.111447 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:19.112140 2817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:19.112933 2817 log.cc:824] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:19.112897 2569 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46254
I20260809 02:25:19.114748 2817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff: No bootstrap required, opened a new log
I20260809 02:25:19.114979 2712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.106133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36564)
0809 02:25:19.106338 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.106350 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:19.106422 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:19.107020 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:19.107023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:19.107173 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:19.107257 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.107264 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.108630 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.108633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.109273 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.109284 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.109854 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.109857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.109941 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.110303 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:19.110313 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:19.111569 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:19.113411 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.113414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.113416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.113647 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.113970 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.113973 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.113975 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.114075 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.114527 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:19.114530 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:19.114621 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 02:25:19.114726 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 02:25:19.114847 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260809 02:25:19.115080 2822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.106321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36564 (local address 127.1.81.252:42505)
0809 02:25:19.106789 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.106797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.106810 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:25:19.106839 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.106842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.106878 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.106999 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.107374 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.108500 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.109415 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.109733 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.110100 (+ 367us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.111680 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.111684 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.111686 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.111710 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.113288 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.113779 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.113782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.113783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.113867 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.114180 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.114183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.114184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.114417 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.114512 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.114786 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.114894 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":123,"threads_started":1}
I20260809 02:25:19.116111 2607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } attempt: 3
I20260809 02:25:19.117813 2707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137: Bootstrap starting.
I20260809 02:25:19.118454 2817 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } }
I20260809 02:25:19.118669 2817 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0876c07e886a47908b4a3fce20197eff, State: Initialized, Role: FOLLOWER
I20260809 02:25:19.118959 2817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } }
I20260809 02:25:19.119449 2827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.119648 2827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:19.120065 2707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:19.120251 2817 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:19.120901 2707 log.cc:824] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:25:19 dist-test-slave-jlzn krb5kdc[2487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242318, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
I20260809 02:25:19.123001 2707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137: No bootstrap required, opened a new log
I20260809 02:25:19.125190 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.116434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:42505 (local address 127.0.0.1:36578)
0809 02:25:19.116654 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:19.116668 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:19.116736 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:19.117002 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:19.117005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:19.117184 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:19.117272 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.117279 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.118183 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.118186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.118905 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:19.118915 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.119482 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.119486 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:19.119563 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.120078 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:19.120093 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:19.121409 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:19.123660 (+ 2251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.123663 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.123665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.123925 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.124232 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:19.124236 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:19.124238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:19.124327 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:19.124751 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:19.124754 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:19.124838 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 02:25:19.124927 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 02:25:19.125043 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
W20260809 02:25:19.125342 2843 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:19.125406 2843 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:19.125720 2822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.116641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36578 (local address 127.1.81.252:42505)
0809 02:25:19.116800 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.116804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.116833 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:25:19.116864 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.116867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.116903 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.116979 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.117392 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.118075 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.119029 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.119348 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.119965 (+ 617us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.121554 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.121558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.121560 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.121583 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.123544 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.124035 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.124039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.124041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.124123 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.124427 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.124430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.124432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.124614 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.124707 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.125473 (+ 766us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.125578 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:25:19.123765 2716 master_runner.cc:186] Error getting master registration for 127.1.81.254:41165: OK, instance_id { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" instance_seqno: 1786242318659887 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:25:19.126785 2707 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } }
I20260809 02:25:19.126981 2707 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96189380460845f09d803c0f1fe24137, State: Initialized, Role: FOLLOWER
I20260809 02:25:19.127017 2716 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:25:19.127281 2707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } }
I20260809 02:25:19.127748 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.128031 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:19.129051 2607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23: Bootstrap starting.
I20260809 02:25:19.129185 2707 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:19.131412 2607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:19.132777 2607 log.cc:824] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23: Log is configured to *not* fsync() on all Append() calls
W20260809 02:25:19.134837 2859 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:19.134953 2859 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:19.132539 2616 master_runner.cc:186] Error getting master registration for 127.1.81.254:41165: OK, instance_id { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" instance_seqno: 1786242318659887 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:25:19.136348 2616 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:25:19.141496 2607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23: No bootstrap required, opened a new log
I20260809 02:25:19.144362 2607 raft_consensus.cc:348] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } }
I20260809 02:25:19.144563 2607 raft_consensus.cc:729] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae6f5d7e54e4e7eb36fffb9e3d5ca23, State: Initialized, Role: FOLLOWER
I20260809 02:25:19.144886 2607 consensus_queue.cc:260] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } }
I20260809 02:25:19.146047 2607 sys_catalog.cc:564] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:19.146258 2569 raft_consensus.cc:482] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 02:25:19.146371 2569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:19.147493 2569 raft_consensus.cc:504] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } }
I20260809 02:25:19.148398 2569 leader_election.cc:288] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [CANDIDATE]: Term 1 election: Requested vote from peers 96189380460845f09d803c0f1fe24137 (127.1.81.253:39571), 0876c07e886a47908b4a3fce20197eff (127.1.81.252:42505)
I20260809 02:25:19.148983 2775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0876c07e886a47908b4a3fce20197eff"
I20260809 02:25:19.149209 2775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:19.149322 2671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "96189380460845f09d803c0f1fe24137"
I20260809 02:25:19.149514 2671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:19.150473 2775 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae6f5d7e54e4e7eb36fffb9e3d5ca23 in term 1.
I20260809 02:25:19.150733 2671 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bae6f5d7e54e4e7eb36fffb9e3d5ca23 in term 1.
I20260809 02:25:19.151513 2534 leader_election.cc:302] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0876c07e886a47908b4a3fce20197eff, bae6f5d7e54e4e7eb36fffb9e3d5ca23; no voters:
I20260809 02:25:19.146063 2864 sys_catalog.cc:455] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.152329 2864 sys_catalog.cc:458] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:19.152406 2864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:19.152472 2864 raft_consensus.cc:686] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [term 1 LEADER]: Becoming Leader. State: Replica: bae6f5d7e54e4e7eb36fffb9e3d5ca23, State: Running, Role: LEADER
I20260809 02:25:19.152752 2864 consensus_queue.cc:237] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } }
I20260809 02:25:19.154443 2864 sys_catalog.cc:455] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bae6f5d7e54e4e7eb36fffb9e3d5ca23. Latest consensus state: current_term: 1 leader_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.154554 2864 sys_catalog.cc:458] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:19.155711 2510 master_runner.cc:263] No leader master found from master bae6f5d7e54e4e7eb36fffb9e3d5ca23
I20260809 02:25:19.155776 2510 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 02:25:19.156744 2538 tablet.cc:2369] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:25:19.160143 2888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:19.163148 2888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:19.168139 2775 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [term 1 FOLLOWER]: Refusing update from remote peer bae6f5d7e54e4e7eb36fffb9e3d5ca23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:19.168785 2886 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:19.172463 2827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [sys.catalog]: SysCatalogTable state changed. Reason: New leader bae6f5d7e54e4e7eb36fffb9e3d5ca23. Latest consensus state: current_term: 1 leader_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.172575 2827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:19.173487 2671 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [term 1 FOLLOWER]: Refusing update from remote peer bae6f5d7e54e4e7eb36fffb9e3d5ca23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:19.174021 2886 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:19.177435 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bae6f5d7e54e4e7eb36fffb9e3d5ca23. Latest consensus state: current_term: 1 leader_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.177547 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:19.181341 2886 sys_catalog.cc:455] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.181460 2886 sys_catalog.cc:458] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:19.182547 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.182647 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:19.183214 2895 mvcc.cc:205] Tried to move back new op lower bound from 7316448539305603072 to 7316448539252928512. Current Snapshot: MvccSnapshot[applied={T|T < 7316448539305603072}]
I20260809 02:25:19.186172 2822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.161953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36592 (local address 127.1.81.252:42505)
0809 02:25:19.162063 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.162068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.163538 (+ 1470us) server_negotiation.cc:407] Connection header received
0809 02:25:19.163742 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.163745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.163793 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.163862 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.166117 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.166902 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.171384 (+ 4482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.171751 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.171847 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.177789 (+ 5942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.177793 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.177796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.177823 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.179448 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.183315 (+ 3867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.183319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.183321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.183417 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.183830 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.183835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.183836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.184046 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.184160 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.185903 (+ 1743us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.186019 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:25:19.186312 2899 mvcc.cc:205] Tried to move back new op lower bound from 7316448539305603072 to 7316448539252928512. Current Snapshot: MvccSnapshot[applied={T|T < 7316448539305603072}]
I20260809 02:25:19.186993 2864 sys_catalog.cc:455] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.187100 2864 sys_catalog.cc:458] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:19.188318 2612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.162351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46264 (local address 127.1.81.254:41165)
0809 02:25:19.162447 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.162452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.164970 (+ 2518us) server_negotiation.cc:407] Connection header received
0809 02:25:19.165121 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.165124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.165166 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.165210 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.168128 (+ 2918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.168869 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.173682 (+ 4813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.173988 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.174065 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.180062 (+ 5997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.180066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.180068 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.180095 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.181693 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.184237 (+ 2544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.184241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.184243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.184324 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.186598 (+ 2274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.186602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.186604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.186825 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.186929 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.188056 (+ 1127us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.188169 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:25:19.188465 2827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bae6f5d7e54e4e7eb36fffb9e3d5ca23" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 41165 } } peers { permanent_uuid: "96189380460845f09d803c0f1fe24137" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 39571 } } peers { permanent_uuid: "0876c07e886a47908b4a3fce20197eff" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 42505 } } }
I20260809 02:25:19.188577 2827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:19.189422 2897 mvcc.cc:205] Tried to move back new op lower bound from 7316448539305603072 to 7316448539252928512. Current Snapshot: MvccSnapshot[applied={T|T < 7316448539305603072}]
I20260809 02:25:19.192514 2888 catalog_manager.cc:1347] Generated new cluster ID: 779dc9ae7b01495fa2b129a02aacd95d
I20260809 02:25:19.192572 2888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:19.193284 2715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:19.162928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59694 (local address 127.1.81.253:39571)
0809 02:25:19.163029 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.163033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.170239 (+ 7206us) server_negotiation.cc:407] Connection header received
0809 02:25:19.170398 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.170401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.170444 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.170490 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.174729 (+ 4239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.175464 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.182247 (+ 6783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:19.182581 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:19.182671 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:19.189807 (+ 7136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:19.189811 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:19.189814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:19.189841 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:19.191431 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.191950 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.191954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.191956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.192040 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:19.192326 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:19.192329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:19.192331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:19.192530 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:19.192655 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:19.193033 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 02:25:19.193142 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:25:19.222406 2888 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:19.223528 2888 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:19.238261 2888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bae6f5d7e54e4e7eb36fffb9e3d5ca23: Generated new TSK 0
I20260809 02:25:19.239035 2888 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:25:19.267717 2612 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.264419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46270 (local address 127.1.81.254:41165)
0809 02:25:19.264537 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.264542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.266385 (+ 1843us) server_negotiation.cc:407] Connection header received
0809 02:25:19.266830 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.266834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.266887 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.266943 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.267574 (+ 631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46270: BlockingRecv error: recv got EOF from 127.0.0.1:46270 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 02:25:19.268863 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.265134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59696 (local address 127.1.81.253:39571)
0809 02:25:19.265251 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.265255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.266743 (+ 1488us) server_negotiation.cc:407] Connection header received
0809 02:25:19.268088 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.268091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.268141 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.268195 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.268753 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59696: BlockingRecv error: recv got EOF from 127.0.0.1:59696 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 02:25:19.270469 2822 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.265839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36602 (local address 127.1.81.252:42505)
0809 02:25:19.265967 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.265971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.269349 (+ 3378us) server_negotiation.cc:407] Connection header received
0809 02:25:19.269745 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.269749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.269799 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.269850 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.270358 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36602: BlockingRecv error: recv got EOF from 127.0.0.1:36602 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 02:25:19.274924 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.273442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59708 (local address 127.1.81.253:39571)
0809 02:25:19.273540 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.273544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.273983 (+ 439us) server_negotiation.cc:407] Connection header received
0809 02:25:19.274203 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.274206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.274279 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.274333 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.274839 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59708: BlockingRecv error: recv got EOF from 127.0.0.1:59708 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:25:19.279796 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.278284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59720 (local address 127.1.81.253:39571)
0809 02:25:19.278380 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.278383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.278935 (+ 552us) server_negotiation.cc:407] Connection header received
0809 02:25:19.279121 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.279124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.279171 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.279221 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.279715 (+ 494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59720: BlockingRecv error: recv got EOF from 127.0.0.1:59720 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:25:19.285269 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.283713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59726 (local address 127.1.81.253:39571)
0809 02:25:19.283841 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.283845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.284401 (+ 556us) server_negotiation.cc:407] Connection header received
0809 02:25:19.284586 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.284589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.284636 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.284699 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.285186 (+ 487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59726: BlockingRecv error: recv got EOF from 127.0.0.1:59726 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 02:25:19.292585 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.291157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59742 (local address 127.1.81.253:39571)
0809 02:25:19.291271 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.291275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.291777 (+ 502us) server_negotiation.cc:407] Connection header received
0809 02:25:19.291979 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.291982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.292024 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.292068 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.292504 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59742: BlockingRecv error: recv got EOF from 127.0.0.1:59742 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 02:25:19.303622 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.302286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.1.81.253:39571)
0809 02:25:19.302373 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.302377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.302851 (+ 474us) server_negotiation.cc:407] Connection header received
0809 02:25:19.303008 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.303010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.303054 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.303101 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.303538 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59748: BlockingRecv error: recv got EOF from 127.0.0.1:59748 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 02:25:19.322749 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.321500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59750 (local address 127.1.81.253:39571)
0809 02:25:19.321614 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.321618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.321855 (+ 237us) server_negotiation.cc:407] Connection header received
0809 02:25:19.322069 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.322072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.322122 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.322194 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.322659 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59750: BlockingRecv error: recv got EOF from 127.0.0.1:59750 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 02:25:19.369379 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.368236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59756 (local address 127.1.81.253:39571)
0809 02:25:19.368352 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.368357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.368514 (+ 157us) server_negotiation.cc:407] Connection header received
0809 02:25:19.368649 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.368652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.368708 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.368802 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.369262 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59756: BlockingRecv error: recv got EOF from 127.0.0.1:59756 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 02:25:19.436057 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.435030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59758 (local address 127.1.81.253:39571)
0809 02:25:19.435140 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.435144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.435305 (+ 161us) server_negotiation.cc:407] Connection header received
0809 02:25:19.435448 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.435451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.435500 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.435561 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.435953 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59758: BlockingRecv error: recv got EOF from 127.0.0.1:59758 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 02:25:19.566979 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.565977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59770 (local address 127.1.81.253:39571)
0809 02:25:19.566134 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.566138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.566240 (+ 102us) server_negotiation.cc:407] Connection header received
0809 02:25:19.566362 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.566364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.566410 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.566479 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.566854 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59770: BlockingRecv error: recv got EOF from 127.0.0.1:59770 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 02:25:19.826018 2715 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:19.824950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59784 (local address 127.1.81.253:39571)
0809 02:25:19.825083 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:19.825088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:19.825147 (+ 59us) server_negotiation.cc:407] Connection header received
0809 02:25:19.825316 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:19.825320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:19.825371 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:19.825438 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:19.825891 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59784: BlockingRecv error: recv got EOF from 127.0.0.1:59784 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:25:20.126586 2843 catalog_manager.cc:1259] Loaded cluster ID: 779dc9ae7b01495fa2b129a02aacd95d
I20260809 02:25:20.126662 2843 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff: loading cluster ID for follower catalog manager: success
I20260809 02:25:20.128324 2843 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff: acquiring CA information for follower catalog manager: success
I20260809 02:25:20.129522 2843 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0876c07e886a47908b4a3fce20197eff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:25:20.136027 2859 catalog_manager.cc:1259] Loaded cluster ID: 779dc9ae7b01495fa2b129a02aacd95d
I20260809 02:25:20.136085 2859 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137: loading cluster ID for follower catalog manager: success
I20260809 02:25:20.137557 2859 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137: acquiring CA information for follower catalog manager: success
I20260809 02:25:20.138540 2859 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 96189380460845f09d803c0f1fe24137: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:25:20.343371 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:20.339889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59800 (local address 127.1.81.253:39571)
0809 02:25:20.340145 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:20.340149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:20.340237 (+ 88us) server_negotiation.cc:407] Connection header received
0809 02:25:20.340358 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:20.340360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:20.340482 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:20.340582 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:20.340796 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.341317 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.342107 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.342317 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.342385 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:20.342627 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:20.343054 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:20.343144 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:20.343172 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 02:25:20.343218 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":73,"threads_started":1}
I20260809 02:25:20.349790 3016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:20.346260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.1.81.252:42505)
0809 02:25:20.346491 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:20.346495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:20.346508 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:25:20.346639 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:20.346650 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:20.346755 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:20.346847 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:20.347062 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.347671 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.348505 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.348735 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.348819 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:20.349092 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:20.349425 (+ 333us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:20.349525 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:20.349595 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 02:25:20.349657 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":72,"threads_started":1}
I20260809 02:25:20.356508 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:20.352630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59816 (local address 127.1.81.253:39571)
0809 02:25:20.352725 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:20.352728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:20.353059 (+ 331us) server_negotiation.cc:407] Connection header received
0809 02:25:20.353220 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:20.353223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:20.353270 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:20.353315 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:20.353629 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.354308 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.355278 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.355600 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.355709 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:20.356095 (+ 386us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:20.356173 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:20.356241 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:20.356336 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 02:25:20.356387 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:25:20.356714 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:20.352413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46280 (local address 127.1.81.254:41165)
0809 02:25:20.352675 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:20.352680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:20.352824 (+ 144us) server_negotiation.cc:407] Connection header received
0809 02:25:20.353003 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:20.353006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:20.353138 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:20.353232 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:20.353575 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.354103 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.355280 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.355620 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.355709 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:20.356095 (+ 386us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:20.356357 (+ 262us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:20.356436 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:20.356514 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 02:25:20.356583 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":61,"threads_started":1}
I20260809 02:25:20.357679 3016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:20.352499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36620 (local address 127.1.81.252:42505)
0809 02:25:20.352604 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:20.352608 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:20.352840 (+ 232us) server_negotiation.cc:407] Connection header received
0809 02:25:20.353031 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:20.353034 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:20.353076 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:20.353160 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:20.353360 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.354070 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.355989 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:20.356257 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:20.356349 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:20.357218 (+ 869us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:20.357287 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:20.357343 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:20.357515 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 02:25:20.357571 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:25:20.359848 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2510
I20260809 02:25:20.377348 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2616
I20260809 02:25:20.386037 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 2716
2026-08-09T02:25:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3127 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:20 dist-test-slave-jlzn krb5kdc[3034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:20 dist-test-slave-jlzn krb5kdc[3034](info): set up 2 sockets
Aug 09 02:25:20 dist-test-slave-jlzn krb5kdc[3034](info): commencing operation
krb5kdc: starting...
W20260809 02:25:21.511178 1351 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/test-user.keytab.
Aug 09 02:25:21 dist-test-slave-jlzn krb5kdc[3034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.81.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
Entry for principal kudu/127.1.81.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab.
I20260809 02:25:21.623939 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:35123
--webserver_interface=127.1.81.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:35123,127.1.81.253:38937,127.1.81.252:43831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:21.728598 3057 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:25:21.728838 3057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:21.728873 3057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:21.728927 3057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:21.732764 3057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:21.732815 3057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:21.732842 3057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:21.732864 3057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:21.732893 3057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:21.737741 3057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:35123,127.1.81.253:38937,127.1.81.252:43831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.254.keytab
--principal=kudu/127.1.81.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.254:35123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.81.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:21.738598 3057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:21.739512 3057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:21.747407 3065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:21.747442 3064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:21.747416 3070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:21.747586 3057 server_base.cc:1034] running on GCE node
I20260809 02:25:21.748181 3057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:21.749135 3057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:21.750289 3057 hybrid_clock.cc:648] HybridClock initialized: now 1786242321750271 us; error 29 us; skew 500 ppm
Aug 09 02:25:21 dist-test-slave-jlzn krb5kdc[3034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:21.753010 3057 init.cc:377] Logged in from keytab as kudu/127.1.81.254@KRBTEST.COM (short username kudu)
I20260809 02:25:21.753755 3057 webserver.cc:460] Webserver started at http://127.1.81.254:34553/ using document root <none> and password file <none>
I20260809 02:25:21.754210 3057 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:21.754264 3057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:21.754418 3057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:21.756250 3057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/data/instance:
uuid: "c4ba8206101c4348aaa7e6859fbba159"
format_stamp: "Formatted at 2026-08-09 02:25:21 on dist-test-slave-jlzn"
server_key: "6bdaa545f77414ecafda1b12ed28bf39"
server_key_iv: "5c6e02f9c478000b2d1f208f7ad471bf"
server_key_version: "encryptionkey@0"
I20260809 02:25:21.756734 3057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/wal/instance:
uuid: "c4ba8206101c4348aaa7e6859fbba159"
format_stamp: "Formatted at 2026-08-09 02:25:21 on dist-test-slave-jlzn"
server_key: "6bdaa545f77414ecafda1b12ed28bf39"
server_key_iv: "5c6e02f9c478000b2d1f208f7ad471bf"
server_key_version: "encryptionkey@0"
I20260809 02:25:21.760028 3057 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:25:21.762108 3077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:21.763173 3057 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:21.763278 3057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/wal
uuid: "c4ba8206101c4348aaa7e6859fbba159"
format_stamp: "Formatted at 2026-08-09 02:25:21 on dist-test-slave-jlzn"
server_key: "6bdaa545f77414ecafda1b12ed28bf39"
server_key_iv: "5c6e02f9c478000b2d1f208f7ad471bf"
server_key_version: "encryptionkey@0"
I20260809 02:25:21.763355 3057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:21.776863 3057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:21.779150 3057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:21.779281 3057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:21.785554 3057 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.254:35123
I20260809 02:25:21.785800 3160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.254:35123 every 8 connection(s)
I20260809 02:25:21.786386 3057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:21.788803 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 3057
I20260809 02:25:21.788913 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-0/wal/instance
I20260809 02:25:21.788904 3161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:21.789178 1351 external_mini_cluster.cc:1428] Setting key 41f08f6fdd5e3ec685f03138c7029513
I20260809 02:25:21.792392 3161 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.81.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.253@KRBTEST.COM" created.
Aug 09 02:25:21 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:25:21.806625 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.794408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:35123 (local address 127.0.0.1:42730)
0809 02:25:21.794988 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.795032 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:21.795851 (+ 819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:21.796570 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:21.796574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:21.796890 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:21.797122 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:21.797134 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.798525 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.798528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:21.799274 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:21.799284 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.799923 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.799928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:21.800079 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:21.800592 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:21.800608 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:21.802095 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:21.804136 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:21.804146 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:21.804154 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:21.804365 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:21.804709 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:21.804711 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:21.804712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:21.804808 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:21.805455 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:21.805459 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:21.805571 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 02:25:21.805704 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 02:25:21.805928 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":27,"spinlock_wait_cycles":27520,"thread_start_us":151,"threads_started":1}
I20260809 02:25:21.806629 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.794408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42730 (local address 127.1.81.254:35123)
0809 02:25:21.794849 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:21.794867 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:21.795138 (+ 271us) server_negotiation.cc:407] Connection header received
0809 02:25:21.796147 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:21.796154 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:21.796393 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:21.796585 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:21.797273 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.798393 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.799379 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.799748 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.799899 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:21.802242 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:21.802249 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:21.802261 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:21.802288 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:21.804017 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:21.804461 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:21.804468 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:21.804470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:21.804613 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:21.804887 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:21.804890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:21.804891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:21.805355 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:21.805498 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:21.805807 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 02:25:21.806002 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":292,"thread_start_us":121,"threads_started":1}
I20260809 02:25:21.808907 3161 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:21.809532 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.809278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51206)
0809 02:25:21.809412 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.809479 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 02:25:21.809705 3081 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
I20260809 02:25:21.810446 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.810255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51222)
0809 02:25:21.810354 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.810397 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 02:25:21.810563 3161 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:38937: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab.
Entry for principal kudu/127.1.81.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab.
I20260809 02:25:21.814281 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.253:38937
--webserver_interface=127.1.81.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab
--principal=kudu/127.1.81.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:35123,127.1.81.253:38937,127.1.81.252:43831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:25:21.859767 3161 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } attempt: 1
I20260809 02:25:21.860455 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.860209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51234)
0809 02:25:21.860336 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.860390 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 02:25:21.861123 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.860945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51238)
0809 02:25:21.861028 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.861069 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 02:25:21.861248 3161 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:38937: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
W20260809 02:25:21.919391 3173 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:25:21.919615 3173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:21.919651 3173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:21.919706 3173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:21.923548 3173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:21.923596 3173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:21.923616 3173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:21.923645 3173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:21.923671 3173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:21.928602 3173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:35123,127.1.81.253:38937,127.1.81.252:43831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.253.keytab
--principal=kudu/127.1.81.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.253:38937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.81.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:21.929391 3161 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } attempt: 2
I20260809 02:25:21.929445 3173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:21.930038 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.929805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51242)
0809 02:25:21.929927 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.929977 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 02:25:21.930507 3173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:21.930676 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.930487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51248)
0809 02:25:21.930569 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.930620 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 02:25:21.930786 3161 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.253:38937: Network error: Client connection negotiation failed: client connection to 127.1.81.253:38937: connect: Connection refused (error 111)
W20260809 02:25:21.938230 3179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:21.938217 3181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:21.938393 3173 server_base.cc:1034] running on GCE node
W20260809 02:25:21.938242 3183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:21.939034 3173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:21.940011 3173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:21.941170 3173 hybrid_clock.cc:648] HybridClock initialized: now 1786242321941156 us; error 31 us; skew 500 ppm
Aug 09 02:25:21 dist-test-slave-jlzn krb5kdc[3034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:21.943638 3173 init.cc:377] Logged in from keytab as kudu/127.1.81.253@KRBTEST.COM (short username kudu)
I20260809 02:25:21.944473 3173 webserver.cc:460] Webserver started at http://127.1.81.253:35953/ using document root <none> and password file <none>
I20260809 02:25:21.944970 3173 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:21.945036 3173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:21.945210 3173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:21.947016 3173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/data/instance:
uuid: "97c15b846f1f40629037d756f35eba19"
format_stamp: "Formatted at 2026-08-09 02:25:21 on dist-test-slave-jlzn"
server_key: "d9da16f5e54e8275da60ff55b4525c9e"
server_key_iv: "081ddeb304bf34c1f92e2f080b0a7c3a"
server_key_version: "encryptionkey@0"
I20260809 02:25:21.947518 3173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/wal/instance:
uuid: "97c15b846f1f40629037d756f35eba19"
format_stamp: "Formatted at 2026-08-09 02:25:21 on dist-test-slave-jlzn"
server_key: "d9da16f5e54e8275da60ff55b4525c9e"
server_key_iv: "081ddeb304bf34c1f92e2f080b0a7c3a"
server_key_version: "encryptionkey@0"
I20260809 02:25:21.950789 3173 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:25:21.952937 3193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:21.953979 3173 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:21.954090 3173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/wal
uuid: "97c15b846f1f40629037d756f35eba19"
format_stamp: "Formatted at 2026-08-09 02:25:21 on dist-test-slave-jlzn"
server_key: "d9da16f5e54e8275da60ff55b4525c9e"
server_key_iv: "081ddeb304bf34c1f92e2f080b0a7c3a"
server_key_version: "encryptionkey@0"
I20260809 02:25:21.954178 3173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:21.966156 3173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:21.968541 3173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:21.968704 3173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:21.974903 3173 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.253:38937
I20260809 02:25:21.975155 3270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.253:38937 every 8 connection(s)
I20260809 02:25:21.975718 3173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/data/info.pb
I20260809 02:25:21.978160 3271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:21.979151 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 3173
I20260809 02:25:21.979267 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-1/wal/instance
I20260809 02:25:21.979519 1351 external_mini_cluster.cc:1428] Setting key f3f03cdfcf64a85ff04ad57f9e7876b4
I20260809 02:25:21.981503 3271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.81.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.81.252@KRBTEST.COM" created.
Aug 09 02:25:21 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:25:21.994762 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.983085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42734 (local address 127.1.81.254:35123)
0809 02:25:21.983208 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:21.983213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:21.983981 (+ 768us) server_negotiation.cc:407] Connection header received
0809 02:25:21.984847 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:21.984851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:21.984912 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:21.985007 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:21.985977 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.986779 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.987824 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.988185 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.988300 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:21.991284 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:21.991288 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:21.991290 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:21.991314 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:21.992810 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:21.993324 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:21.993328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:21.993330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:21.993428 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:21.993716 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:21.993719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:21.993721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:21.993935 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:21.994032 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:21.994474 (+ 442us) server_negotiation.cc:299] Negotiation successful
0809 02:25:21.994601 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:25:21.995318 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.983387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:35123 (local address 127.0.0.1:42734)
0809 02:25:21.983835 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.983884 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:21.984656 (+ 772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:21.985125 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:21.985131 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:21.985444 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:21.985845 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:21.985858 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.986883 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.986885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:21.987690 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:21.987699 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.988327 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.988330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:21.988460 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:21.988886 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:21.988902 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:21.991125 (+ 2223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:21.992925 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:21.992930 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:21.992940 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:21.993237 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:21.993510 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:21.993512 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:21.993513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:21.993630 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:21.994020 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:21.994024 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:21.994230 (+ 206us) client_negotiation.cc:769] Sending connection context
0809 02:25:21.994365 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 02:25:21.994586 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":96,"threads_started":1}
I20260809 02:25:21.996763 3271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:25:21 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
I20260809 02:25:22.005023 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.997180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51252)
0809 02:25:21.997274 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:21.997286 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:21.997358 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:21.997900 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:21.997902 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:21.998021 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:21.998099 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:21.998104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.999409 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:21.999412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:21.999979 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:21.999987 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.000541 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.000544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.000613 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.000977 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:22.000988 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:22.002057 (+ 1069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:22.003728 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.003730 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.003732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.003950 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.004218 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.004220 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.004221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.004290 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.004656 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:22.004658 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:22.004730 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 02:25:22.004820 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:25:22.004918 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 02:25:22.005223 3281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:21.997259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.1.81.253:38937)
0809 02:25:21.997515 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:21.997526 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:21.997548 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:25:21.997591 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:21.997597 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:21.997782 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:21.997914 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:21.998201 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:21.999313 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.000064 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.000447 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.000522 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.002172 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.002181 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.002191 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.002212 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.003589 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.004052 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.004058 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.004060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.004145 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.004345 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.004346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.004348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.004576 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.004679 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.004899 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.005006 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":82,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.81.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab.
Entry for principal kudu/127.1.81.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab.
I20260809 02:25:22.007179 1351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAskc7b/build/debug/bin/kudu
/tmp/dist-test-taskAskc7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.252:43831
--webserver_interface=127.1.81.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab
--principal=kudu/127.1.81.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.81.212:35517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.81.254:35123,127.1.81.253:38937,127.1.81.252:43831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:25:22.007874 3271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:22.008422 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.008212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58538)
0809 02:25:22.008309 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.008373 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 02:25:22.008648 3196 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
I20260809 02:25:22.009451 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.009268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58540)
0809 02:25:22.009365 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.009406 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 02:25:22.009590 3271 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:43831: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
I20260809 02:25:22.021912 3161 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } attempt: 3
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
I20260809 02:25:22.029526 3281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.022316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51260 (local address 127.1.81.253:38937)
0809 02:25:22.022425 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.022429 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.022441 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:25:22.022501 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.022503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.022540 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.022597 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.022967 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.023445 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.024186 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.024422 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.024507 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.026331 (+ 1824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.026335 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.026337 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.026361 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.028117 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.028488 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.028491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.028493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.028569 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.028812 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.028815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.028816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.028974 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.029055 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.029309 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.029403 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:25:22.029526 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.022244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51260)
0809 02:25:22.022346 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.022358 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:22.022433 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:22.022624 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:22.022627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:22.022773 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:22.022864 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.022869 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.023543 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.023546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.024082 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.024091 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.024517 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.024521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.024614 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.024989 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:22.025000 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:22.026208 (+ 1208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:22.028215 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.028219 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.028221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.028402 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.028649 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.028652 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.028655 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.028733 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.029061 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:22.029065 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:22.029161 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 02:25:22.029246 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:25:22.029371 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:25:22.030150 3161 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:22.030756 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.030562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58552)
0809 02:25:22.030659 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.030702 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:25:22.031386 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.031172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58558)
0809 02:25:22.031294 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.031340 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 02:25:22.031489 3161 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:43831: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
I20260809 02:25:22.058766 3271 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } attempt: 1
I20260809 02:25:22.059293 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.059093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58570)
0809 02:25:22.059196 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.059239 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 02:25:22.059939 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.059721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58578)
0809 02:25:22.059849 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.059891 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 02:25:22.060057 3271 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:43831: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
I20260809 02:25:22.062623 3161 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } attempt: 1
I20260809 02:25:22.063098 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.062917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58588)
0809 02:25:22.063011 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.063052 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 02:25:22.063657 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.063478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58600)
0809 02:25:22.063567 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.063608 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 02:25:22.063761 3161 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:43831: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
W20260809 02:25:22.115137 3284 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:25:22.115371 3284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:22.115410 3284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:22.115471 3284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:22.119318 3284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:22.119369 3284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:22.119395 3284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:22.119417 3284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:22.119446 3284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:22.124447 3284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.81.212:35517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.81.254:35123,127.1.81.253:38937,127.1.81.252:43831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/krb5kdc/kudu_127.1.81.252.keytab
--principal=kudu/127.1.81.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.81.252:43831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.81.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:22.125324 3284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:22.126204 3284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:22.128196 3271 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } attempt: 2
I20260809 02:25:22.128885 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.128644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58616)
0809 02:25:22.128766 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.128818 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 02:25:22.129530 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.129331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58620)
0809 02:25:22.129432 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.129475 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 02:25:22.129652 3271 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:43831: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
W20260809 02:25:22.134236 3292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:22.134303 3295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:22.134303 3291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:22.134617 3284 server_base.cc:1034] running on GCE node
I20260809 02:25:22.135347 3284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:22.136328 3284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:22.137480 3284 hybrid_clock.cc:648] HybridClock initialized: now 1786242322137465 us; error 26 us; skew 500 ppm
I20260809 02:25:22.138928 3161 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } attempt: 2
I20260809 02:25:22.139570 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.139309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58634)
0809 02:25:22.139449 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.139505 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242322, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:22.140231 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.140044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58638)
0809 02:25:22.140133 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.140180 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 02:25:22.140267 3284 init.cc:377] Logged in from keytab as kudu/127.1.81.252@KRBTEST.COM (short username kudu)
W20260809 02:25:22.140348 3161 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.81.252:43831: Network error: Client connection negotiation failed: client connection to 127.1.81.252:43831: connect: Connection refused (error 111)
I20260809 02:25:22.141076 3284 webserver.cc:460] Webserver started at http://127.1.81.252:34919/ using document root <none> and password file <none>
I20260809 02:25:22.141569 3284 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:22.141631 3284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:22.141824 3284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:22.143677 3284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/data/instance:
uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651"
format_stamp: "Formatted at 2026-08-09 02:25:22 on dist-test-slave-jlzn"
server_key: "0a34b7eecc482b7fa40abf57742fe7d9"
server_key_iv: "2638936bca834f137fe52dec3d871ef8"
server_key_version: "encryptionkey@0"
I20260809 02:25:22.144260 3284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/wal/instance:
uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651"
format_stamp: "Formatted at 2026-08-09 02:25:22 on dist-test-slave-jlzn"
server_key: "0a34b7eecc482b7fa40abf57742fe7d9"
server_key_iv: "2638936bca834f137fe52dec3d871ef8"
server_key_version: "encryptionkey@0"
I20260809 02:25:22.147594 3284 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:25:22.149787 3304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:22.150883 3284 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:22.150997 3284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/data,/tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/wal
uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651"
format_stamp: "Formatted at 2026-08-09 02:25:22 on dist-test-slave-jlzn"
server_key: "0a34b7eecc482b7fa40abf57742fe7d9"
server_key_iv: "2638936bca834f137fe52dec3d871ef8"
server_key_version: "encryptionkey@0"
I20260809 02:25:22.151098 3284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:22.167542 3284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:22.170404 3284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:22.170570 3284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:22.177011 3284 rpc_server.cc:307] RPC server started. Bound to: 127.1.81.252:43831
I20260809 02:25:22.177290 3373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.81.252:43831 every 8 connection(s)
I20260809 02:25:22.177873 3284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/data/info.pb
I20260809 02:25:22.180675 3376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:22.182823 1351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAskc7b/build/debug/bin/kudu as pid 3284
I20260809 02:25:22.182947 1351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAskc7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242040541704-1351-0/minicluster-data/master-2/wal/instance
I20260809 02:25:22.183223 1351 external_mini_cluster.cc:1428] Setting key 201e9dc4e66201558e20957d5e05cdf3
I20260809 02:25:22.184399 3376 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242322, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
I20260809 02:25:22.196738 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.186212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42738 (local address 127.1.81.254:35123)
0809 02:25:22.186364 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.186368 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.186686 (+ 318us) server_negotiation.cc:407] Connection header received
0809 02:25:22.187025 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.187028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.187088 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.187154 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.188271 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.188759 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.190139 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.190349 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.190438 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.192854 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.192858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.192860 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.192885 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.194692 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.195192 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.195196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.195197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.195292 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.195681 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.195684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.195686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.195925 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.196000 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.196463 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.196576 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:25:22.197446 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.184407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58652 (local address 127.1.81.252:43831)
0809 02:25:22.184838 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.184856 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.185022 (+ 166us) server_negotiation.cc:407] Connection header received
0809 02:25:22.186855 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.186871 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.187050 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.187184 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.188090 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.188920 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.190067 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.190421 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.190560 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.193142 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.193149 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.193158 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.193179 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.194575 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.194994 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.195000 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.195002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.195139 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.195465 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.195468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.195470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.195917 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.196115 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.196323 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.196583 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":294,"thread_start_us":125,"threads_started":1}
I20260809 02:25:22.197458 3383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.186103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.254:35123 (local address 127.0.0.1:42738)
0809 02:25:22.186569 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.186606 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:22.186856 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:22.187326 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:22.187331 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:22.187743 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:22.188142 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.188156 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.188861 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.188864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.189993 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.190004 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.190488 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.190492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.190613 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.191201 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:22.191221 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:22.192723 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:22.194797 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.194807 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.194815 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.195079 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.195396 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.195399 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.195401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.195554 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.196080 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:22.196085 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:22.196219 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 02:25:22.196876 (+ 657us) client_negotiation.cc:240] Negotiation successful
0809 02:25:22.197039 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":44,"thread_start_us":116,"threads_started":1}
I20260809 02:25:22.198633 3376 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242322, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.254@KRBTEST.COM
I20260809 02:25:22.206254 3383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.199014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.253:38937 (local address 127.0.0.1:51268)
0809 02:25:22.199120 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.199131 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:22.199199 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:22.199478 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:22.199480 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:22.199639 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:22.199756 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.199763 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.200474 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.200477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.200975 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.200983 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.201403 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.201406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.201497 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.201910 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:22.201924 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:22.203061 (+ 1137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:22.204921 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.204923 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.204924 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.205101 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.205364 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.205367 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.205369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.205442 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.205787 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:22.205790 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:22.205878 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 02:25:22.205985 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 02:25:22.206099 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:25:22.206312 3281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.199151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.1.81.253:38937)
0809 02:25:22.199278 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.199282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.199297 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:25:22.199339 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.199342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.199388 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.199470 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.199882 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.200375 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.201084 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.201309 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.201394 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.203192 (+ 1798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.203195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.203197 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.203219 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.204653 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.205197 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.205201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.205203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.205280 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.205523 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.205526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.205528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.205698 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.205781 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.206064 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.206162 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:25:22.206903 3376 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:25:22.207746 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.199735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.1.81.254:35123)
0809 02:25:22.199861 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.199865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.199906 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:25:22.200021 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.200024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.200063 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.200124 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.200661 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.201112 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.201874 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.202183 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.202285 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.204458 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.204462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.204465 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.204492 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.205790 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.206206 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.206209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.206211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.206291 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.206896 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.206899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.206900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.207108 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.207280 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.207492 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.207604 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242322, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.252@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.81.253@KRBTEST.COM
I20260809 02:25:22.214571 3383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.207348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58666)
0809 02:25:22.207451 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.207464 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:22.207530 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:22.208027 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:22.208030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:22.208188 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:22.208273 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.208281 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.209032 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.209035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.209585 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.209595 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.210024 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.210028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.210109 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.210500 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:22.210511 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:22.211647 (+ 1136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:22.213159 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.213162 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.213163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.213369 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.213644 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.213646 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.213648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.213725 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.214059 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:22.214061 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:22.214151 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 02:25:22.214258 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 02:25:22.214381 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 02:25:22.214597 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.207531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58666 (local address 127.1.81.252:43831)
0809 02:25:22.207621 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.207624 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.207636 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:25:22.207682 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.207685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.207720 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.207778 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.208387 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.208936 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.209698 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.209920 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.209988 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.211755 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.211758 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.211760 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.211781 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.213054 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.213470 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.213474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.213476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.213562 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.213807 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.213809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.213810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.213961 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.214054 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.214311 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.214432 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":35}
I20260809 02:25:22.216849 3281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.208813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51272 (local address 127.1.81.253:38937)
0809 02:25:22.208906 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.208910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.208924 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:25:22.208953 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.208955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.208989 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.209074 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.209568 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.210253 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.211053 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.211257 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.211341 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.213762 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.213766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.213769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.213794 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.215397 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.215771 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.215775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.215776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.215888 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.216097 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.216100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.216101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.216286 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.216521 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.216601 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.216713 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:25:22.218068 3376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651: Bootstrap starting.
I20260809 02:25:22.219796 1351 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:22.220708 3376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:22.220795 3271 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } attempt: 3
I20260809 02:25:22.221590 3376 log.cc:824] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:22.221051 3118 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c4ba8206101c4348aaa7e6859fbba159"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42752
I20260809 02:25:22.223570 3376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651: No bootstrap required, opened a new log
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.253@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
I20260809 02:25:22.226975 3376 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } }
I20260809 02:25:22.227200 3376 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d9b2ebc1c8d4a4cb45e9cfda1bf7651, State: Initialized, Role: FOLLOWER
I20260809 02:25:22.227528 3376 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } }
I20260809 02:25:22.228029 3388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.228181 3388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:22.228832 3376 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:22.228958 3278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.221141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58670)
0809 02:25:22.221246 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.221260 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:22.221331 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:22.221571 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:22.221573 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:22.221734 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:22.221825 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.221832 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.222753 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.222757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.223489 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.223500 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.224052 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.224056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.224134 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.224545 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:22.224559 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:22.225754 (+ 1195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:22.227449 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.227452 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.227454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.227634 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.227945 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.227948 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.227950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.228046 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.228506 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:22.228510 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:22.228606 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 02:25:22.228689 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:25:22.228810 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:25:22.228967 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.221294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58670 (local address 127.1.81.252:43831)
0809 02:25:22.221380 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.221383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.221397 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:25:22.221428 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.221431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.221464 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.221540 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.221955 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.222614 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.223594 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.223941 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.224025 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.225892 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.225896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.225898 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.225947 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.227344 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.227720 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.227724 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.227726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.227831 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.228164 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.228167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.228168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.228413 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.228500 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.228752 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.228844 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:25:22.231900 3271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19: Bootstrap starting.
W20260809 02:25:22.233610 3405 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:22.233741 3405 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:22.234398 3271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:22.235268 3271 log.cc:824] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:22.232494 3284 master_runner.cc:186] Error getting master registration for 127.1.81.254:35123: OK, instance_id { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" instance_seqno: 1786242321783779 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:25:22.235634 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:25:22.237313 3271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19: No bootstrap required, opened a new log
I20260809 02:25:22.239440 3161 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } attempt: 3
I20260809 02:25:22.241206 3271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } }
I20260809 02:25:22.241422 3271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c15b846f1f40629037d756f35eba19, State: Initialized, Role: FOLLOWER
I20260809 02:25:22.241731 3271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } }
I20260809 02:25:22.242300 3409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.242516 3409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:22.242966 3271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 02:25:22 dist-test-slave-jlzn krb5kdc[3034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242321, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.81.254@KRBTEST.COM for kudu/127.1.81.252@KRBTEST.COM
I20260809 02:25:22.248282 3167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.239910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.81.252:43831 (local address 127.0.0.1:58686)
0809 02:25:22.240062 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:22.240074 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:22.240162 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:22.240371 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:22.240374 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:22.240549 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:22.240637 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.240643 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.241289 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.241293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.242096 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:22.242107 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.242790 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.242793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:22.242880 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.243352 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:22.243369 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:22.244772 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:22.246711 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.246714 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.246716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.246960 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.247273 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:22.247276 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:22.247278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:22.247367 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:22.247785 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:22.247788 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:22.247903 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 02:25:22.247995 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 02:25:22.248128 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
W20260809 02:25:22.248291 3425 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:22.248355 3425 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:22.248706 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.239935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58686 (local address 127.1.81.252:43831)
0809 02:25:22.240023 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.240027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.240123 (+ 96us) server_negotiation.cc:407] Connection header received
0809 02:25:22.240247 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.240250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.240286 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.240344 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.240741 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.241191 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.242242 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.242534 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.242629 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.244892 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.244895 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.244898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.244922 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.246581 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.247080 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.247083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.247085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.247171 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.247462 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.247465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.247467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.247653 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.247739 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.248464 (+ 725us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.248570 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:25:22.246417 3173 master_runner.cc:186] Error getting master registration for 127.1.81.254:35123: OK, instance_id { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" instance_seqno: 1786242321783779 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:25:22.250073 3173 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:25:22.253082 3161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159: Bootstrap starting.
I20260809 02:25:22.255623 3161 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:22.256561 3161 log.cc:824] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:22.261518 3161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159: No bootstrap required, opened a new log
I20260809 02:25:22.264456 3161 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } }
I20260809 02:25:22.264662 3161 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4ba8206101c4348aaa7e6859fbba159, State: Initialized, Role: FOLLOWER
I20260809 02:25:22.264953 3161 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } }
I20260809 02:25:22.266089 3161 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:22.271279 3118 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 02:25:22.271389 3118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:22.272584 3118 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } }
I20260809 02:25:22.273926 3233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4ba8206101c4348aaa7e6859fbba159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "97c15b846f1f40629037d756f35eba19"
I20260809 02:25:22.274149 3233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:22.275213 3341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4ba8206101c4348aaa7e6859fbba159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651"
I20260809 02:25:22.275426 3233 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4ba8206101c4348aaa7e6859fbba159 in term 1.
I20260809 02:25:22.275439 3341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:22.275900 3081 leader_election.cc:302] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c15b846f1f40629037d756f35eba19, c4ba8206101c4348aaa7e6859fbba159; no voters:
I20260809 02:25:22.277103 3341 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4ba8206101c4348aaa7e6859fbba159 in term 1.
W20260809 02:25:22.278170 3444 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:22.278292 3444 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:22.278481 3118 leader_election.cc:288] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [CANDIDATE]: Term 1 election: Requested vote from peers 97c15b846f1f40629037d756f35eba19 (127.1.81.253:38937), 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 (127.1.81.252:43831)
W20260809 02:25:22.280568 3089 tablet.cc:2369] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:25:22.280680 3430 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.280783 3430 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:22.280850 3430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:22.280912 3430 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [term 1 LEADER]: Becoming Leader. State: Replica: c4ba8206101c4348aaa7e6859fbba159, State: Running, Role: LEADER
I20260809 02:25:22.281193 3430 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } }
I20260809 02:25:22.282282 3057 master_runner.cc:263] No leader master found from master c4ba8206101c4348aaa7e6859fbba159
I20260809 02:25:22.282347 3057 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:25:22.283388 3430 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4ba8206101c4348aaa7e6859fbba159. Latest consensus state: current_term: 1 leader_uuid: "c4ba8206101c4348aaa7e6859fbba159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.283494 3430 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:22.285555 3454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:22.286419 3454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:22.294090 3281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.284561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51282 (local address 127.1.81.253:38937)
0809 02:25:22.284660 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.284664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.285262 (+ 598us) server_negotiation.cc:407] Connection header received
0809 02:25:22.285438 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.285442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.285484 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.285530 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.286594 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.287373 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.288564 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.288910 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.289015 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.290603 (+ 1588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.290607 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.290610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.290636 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.292295 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.292775 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.292779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.292780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.292866 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.293170 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.293174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.293176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.293382 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.293480 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.293829 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.293938 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:25:22.303396 3341 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [term 1 FOLLOWER]: Refusing update from remote peer c4ba8206101c4348aaa7e6859fbba159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:22.303642 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.292358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58692 (local address 127.1.81.252:43831)
0809 02:25:22.292456 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.292460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.295489 (+ 3029us) server_negotiation.cc:407] Connection header received
0809 02:25:22.295638 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.295641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.295684 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.295732 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.296559 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.297300 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.298366 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.298704 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.298774 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.300344 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.300348 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.300350 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.300375 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.301878 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.302370 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.302374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.302375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.302461 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.302756 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.302759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.302761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.302956 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.303049 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.303391 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.303498 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:25:22.304141 3446 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:22.308442 3388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4ba8206101c4348aaa7e6859fbba159. Latest consensus state: current_term: 1 leader_uuid: "c4ba8206101c4348aaa7e6859fbba159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.308578 3388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:22.309425 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:22.284192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42768 (local address 127.1.81.254:35123)
0809 02:25:22.284290 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.284294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.292080 (+ 7786us) server_negotiation.cc:407] Connection header received
0809 02:25:22.292906 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.292910 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.292953 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.293000 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.293805 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.294553 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.303598 (+ 9045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:22.303925 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:22.303995 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:22.305818 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:22.305821 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:22.305824 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:22.305850 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:22.307395 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.307857 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.307861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.307862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.307949 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:22.308260 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:22.308264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:22.308266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:22.308465 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:22.308587 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:22.309168 (+ 581us) server_negotiation.cc:299] Negotiation successful
0809 02:25:22.309279 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:25:22.309497 3233 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [term 1 FOLLOWER]: Refusing update from remote peer c4ba8206101c4348aaa7e6859fbba159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:22.310225 3446 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:22.313756 3409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4ba8206101c4348aaa7e6859fbba159. Latest consensus state: current_term: 1 leader_uuid: "c4ba8206101c4348aaa7e6859fbba159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.313863 3409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:22.315529 3430 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c4ba8206101c4348aaa7e6859fbba159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.315634 3430 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:22.315882 3388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c4ba8206101c4348aaa7e6859fbba159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.315987 3388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:22.321276 3454 catalog_manager.cc:1347] Generated new cluster ID: ac9802beb992409ea0b2ebb62bc3d63b
I20260809 02:25:22.321336 3454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:22.321456 3463 mvcc.cc:205] Tried to move back new op lower bound from 7316448552146751488 to 7316448552069267456. Current Snapshot: MvccSnapshot[applied={T|T < 7316448552146751488}]
I20260809 02:25:22.325871 3430 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c4ba8206101c4348aaa7e6859fbba159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.325979 3430 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:22.327615 3409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c4ba8206101c4348aaa7e6859fbba159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4ba8206101c4348aaa7e6859fbba159" member_type: VOTER last_known_addr { host: "127.1.81.254" port: 35123 } } peers { permanent_uuid: "97c15b846f1f40629037d756f35eba19" member_type: VOTER last_known_addr { host: "127.1.81.253" port: 38937 } } peers { permanent_uuid: "9d9b2ebc1c8d4a4cb45e9cfda1bf7651" member_type: VOTER last_known_addr { host: "127.1.81.252" port: 43831 } } }
I20260809 02:25:22.327726 3409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:25:22.327708 3468 mvcc.cc:205] Tried to move back new op lower bound from 7316448552146751488 to 7316448552069267456. Current Snapshot: MvccSnapshot[applied={T|T < 7316448552146751488}]
I20260809 02:25:22.348004 3454 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:22.349161 3454 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:22.368316 3454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4ba8206101c4348aaa7e6859fbba159: Generated new TSK 0
I20260809 02:25:22.369020 3454 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:25:22.398422 3166 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.395657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42780 (local address 127.1.81.254:35123)
0809 02:25:22.395774 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.395778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.397388 (+ 1610us) server_negotiation.cc:407] Connection header received
0809 02:25:22.397595 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.397599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.397648 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.397698 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.398291 (+ 593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42780: BlockingRecv error: recv got EOF from 127.0.0.1:42780 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 02:25:22.399766 3382 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.396440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58700 (local address 127.1.81.252:43831)
0809 02:25:22.396551 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.396556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.398909 (+ 2353us) server_negotiation.cc:407] Connection header received
0809 02:25:22.399067 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.399071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.399116 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.399162 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.399644 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58700: BlockingRecv error: recv got EOF from 127.0.0.1:58700 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 02:25:22.401119 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.396814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51284 (local address 127.1.81.253:38937)
0809 02:25:22.396921 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.396925 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.400229 (+ 3304us) server_negotiation.cc:407] Connection header received
0809 02:25:22.400449 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.400452 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.400498 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.400546 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.401012 (+ 466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51284: BlockingRecv error: recv got EOF from 127.0.0.1:51284 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 02:25:22.405128 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.403685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51288 (local address 127.1.81.253:38937)
0809 02:25:22.403775 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.403779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.404264 (+ 485us) server_negotiation.cc:407] Connection header received
0809 02:25:22.404456 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.404459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.404522 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.404581 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.405039 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51288: BlockingRecv error: recv got EOF from 127.0.0.1:51288 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 02:25:22.409801 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.408463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.1.81.253:38937)
0809 02:25:22.408562 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.408566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.409013 (+ 447us) server_negotiation.cc:407] Connection header received
0809 02:25:22.409182 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.409185 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.409227 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.409271 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.409718 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51296: BlockingRecv error: recv got EOF from 127.0.0.1:51296 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260809 02:25:22.414978 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.413673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51304 (local address 127.1.81.253:38937)
0809 02:25:22.413760 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.413764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.414207 (+ 443us) server_negotiation.cc:407] Connection header received
0809 02:25:22.414367 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.414370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.414411 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.414454 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.414898 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51304: BlockingRecv error: recv got EOF from 127.0.0.1:51304 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 02:25:22.422442 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.421004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51306 (local address 127.1.81.253:38937)
0809 02:25:22.421128 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.421132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.421622 (+ 490us) server_negotiation.cc:407] Connection header received
0809 02:25:22.421794 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.421797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.421842 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.421889 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.422354 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51306: BlockingRecv error: recv got EOF from 127.0.0.1:51306 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 02:25:22.434278 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.432587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51312 (local address 127.1.81.253:38937)
0809 02:25:22.432687 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.432691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.433218 (+ 527us) server_negotiation.cc:407] Connection header received
0809 02:25:22.433399 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.433402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.433448 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.433495 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.434183 (+ 688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51312: BlockingRecv error: recv got EOF from 127.0.0.1:51312 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:25:22.453725 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.452562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51314 (local address 127.1.81.253:38937)
0809 02:25:22.452696 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.452700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.452957 (+ 257us) server_negotiation.cc:407] Connection header received
0809 02:25:22.453095 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.453097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.453137 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.453212 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.453625 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51314: BlockingRecv error: recv got EOF from 127.0.0.1:51314 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 02:25:22.488462 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.487423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51322 (local address 127.1.81.253:38937)
0809 02:25:22.487562 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.487566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.487678 (+ 112us) server_negotiation.cc:407] Connection header received
0809 02:25:22.487827 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.487830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.487872 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.487939 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.488372 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51322: BlockingRecv error: recv got EOF from 127.0.0.1:51322 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 02:25:22.555048 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.554112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51328 (local address 127.1.81.253:38937)
0809 02:25:22.554230 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.554234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.554362 (+ 128us) server_negotiation.cc:407] Connection header received
0809 02:25:22.554465 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.554467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.554507 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.554576 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.554944 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51328: BlockingRecv error: recv got EOF from 127.0.0.1:51328 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 02:25:22.686044 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.684934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51332 (local address 127.1.81.253:38937)
0809 02:25:22.685079 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.685084 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.685219 (+ 135us) server_negotiation.cc:407] Connection header received
0809 02:25:22.685368 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.685371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.685420 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.685487 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.685944 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51332: BlockingRecv error: recv got EOF from 127.0.0.1:51332 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 02:25:22.945310 3281 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:22.944151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51334 (local address 127.1.81.253:38937)
0809 02:25:22.944289 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:22.944294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:22.944399 (+ 105us) server_negotiation.cc:407] Connection header received
0809 02:25:22.944557 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:22.944560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:22.944611 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:22.944680 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:22.945190 (+ 510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51334: BlockingRecv error: recv got EOF from 127.0.0.1:51334 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:25:23.234970 3405 catalog_manager.cc:1259] Loaded cluster ID: ac9802beb992409ea0b2ebb62bc3d63b
I20260809 02:25:23.235051 3405 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651: loading cluster ID for follower catalog manager: success
I20260809 02:25:23.236725 3405 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651: acquiring CA information for follower catalog manager: success
I20260809 02:25:23.237840 3405 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9d9b2ebc1c8d4a4cb45e9cfda1bf7651: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:25:23.249341 3425 catalog_manager.cc:1259] Loaded cluster ID: ac9802beb992409ea0b2ebb62bc3d63b
I20260809 02:25:23.249397 3425 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19: loading cluster ID for follower catalog manager: success
I20260809 02:25:23.250814 3425 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19: acquiring CA information for follower catalog manager: success
I20260809 02:25:23.251840 3425 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 97c15b846f1f40629037d756f35eba19: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:25:23.463269 3569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:23.459327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51344 (local address 127.1.81.253:38937)
0809 02:25:23.459570 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:23.459575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:23.459710 (+ 135us) server_negotiation.cc:407] Connection header received
0809 02:25:23.459868 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:23.459872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:23.459999 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:23.460098 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:23.460376 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.460897 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.461782 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.462013 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.462104 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:23.462426 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:23.462860 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:23.462971 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:23.463046 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 02:25:23.463105 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":67,"threads_started":1}
I20260809 02:25:23.469579 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:23.466070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58714 (local address 127.1.81.252:43831)
0809 02:25:23.466346 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:23.466351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:23.466364 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:25:23.466443 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:23.466445 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:23.466543 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:23.466661 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:23.466859 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.467451 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.468298 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.468521 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.468604 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:23.468875 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:23.469206 (+ 331us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:23.469305 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:23.469379 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 02:25:23.469434 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":66,"threads_started":1}
I20260809 02:25:23.476097 3569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:23.472331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51348 (local address 127.1.81.253:38937)
0809 02:25:23.472543 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:23.472547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:23.472732 (+ 185us) server_negotiation.cc:407] Connection header received
0809 02:25:23.472852 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:23.472855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:23.472909 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:23.472971 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:23.473274 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.473853 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.474946 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.475271 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.475356 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:23.475576 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:23.475648 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:23.475712 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:23.475932 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 02:25:23.475981 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260809 02:25:23.476428 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:23.472425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58718 (local address 127.1.81.252:43831)
0809 02:25:23.472521 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:23.472525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:23.472945 (+ 420us) server_negotiation.cc:407] Connection header received
0809 02:25:23.473044 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:23.473046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:23.473089 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:23.473165 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:23.473383 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.474086 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.475161 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.475479 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.475570 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:23.476000 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:23.476077 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:23.476142 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:23.476263 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 02:25:23.476313 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:25:23.477010 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:23.472245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42786 (local address 127.1.81.254:35123)
0809 02:25:23.472490 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:23.472495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:23.472766 (+ 271us) server_negotiation.cc:407] Connection header received
0809 02:25:23.472966 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:23.472969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:23.473115 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:23.473216 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:23.473568 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.474305 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.475206 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:23.475558 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:23.475646 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:23.476321 (+ 675us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:23.476594 (+ 273us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:23.476685 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:23.476813 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 02:25:23.476868 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":68,"threads_started":1}
I20260809 02:25:23.479584 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 3057
I20260809 02:25:23.490914 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 3173
I20260809 02:25:23.502735 1351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAskc7b/build/debug/bin/kudu with pid 3284
2026-08-09T02:25:23Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3116 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6244 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (282958 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST